Hugging Face's logo
basit123796
/
Runtime error

runtime error

07M/3.85G [00:13<00:27, 110MB/s]  pytorch_model-00002-of-00002.bin: 31%|β–ˆβ–ˆβ–ˆβ– | 1.21G/3.85G [00:15<00:16, 164MB/s] pytorch_model-00002-of-00002.bin: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 1.54G/3.85G [00:16<00:11, 196MB/s] pytorch_model-00002-of-00002.bin: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1.87G/3.85G [00:17<00:09, 210MB/s] pytorch_model-00002-of-00002.bin: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 2.34G/3.85G [00:18<00:05, 262MB/s] pytorch_model-00002-of-00002.bin: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 2.68G/3.85G [00:22<00:06, 177MB/s] pytorch_model-00002-of-00002.bin: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 2.94G/3.85G [00:25<00:06, 134MB/s] pytorch_model-00002-of-00002.bin: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 3.27G/3.85G [00:26<00:03, 163MB/s] pytorch_model-00002-of-00002.bin: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 3.63G/3.85G [00:27<00:01, 199MB/s] pytorch_model-00002-of-00002.bin: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 3.85G/3.85G [00:29<00:00, 132MB/s] Downloading shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [01:43<00:00, 47.91s/it] Downloading shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2/2 [01:43<00:00, 51.84s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 124, in <module> model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto") File "/home/user/.local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 566, in from_pretrained return model_class.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3850, in from_pretrained ) = cls._load_pretrained_model( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3979, in _load_pretrained_model raise ValueError( ValueError: The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them. Alternatively, make sure you have `safetensors` installed if the model you are using offers the weights in this format.

Container logs:

Fetching error logs...