Spaces:

OpenGVLab
/

VideoChatGPT

Runtime error

ynhe commited on May 18, 2023

Commit

6afc77b

•

1 Parent(s): ad1552b

Update models/videochat.py

Files changed (1) hide show

models/videochat.py CHANGED Viewed

@@ -137,6 +137,8 @@ class VideoChat(Blip2Base):
                     llama_model_path,
                     torch_dtype=torch.float16,
                     use_auth_token=os.environ["HF_TOKEN"],
                 )
         print("freeze LLAMA")

                     llama_model_path,
                     torch_dtype=torch.float16,
                     use_auth_token=os.environ["HF_TOKEN"],
+                    load_in_8bit=True,
+                    device_map="auto"
                 )
         print("freeze LLAMA")