Error running the code:
1
#29 opened about 1 year ago
by
Andyrasika
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6290ec00a29097b211b94f0f/7OYU-yroOUxJryJkl33L6.png)
How to run qlora with stable vicuna?
1
#28 opened about 1 year ago
by
Andyrasika
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6290ec00a29097b211b94f0f/7OYU-yroOUxJryJkl33L6.png)
Could not find model in TheBloke/stable-vicuna-13B-GPTQ
3
#27 opened about 1 year ago
by
AB00k
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63c282fd8cc87cf0c057420d/kcH8CPemTkTAPMA-o7hRT.png)
HF/bitsandbytes load_in_4bit is now apparently live apparently! (in peft)
3
#24 opened over 1 year ago
by
2themaxx
Issue starting the webui
7
#23 opened over 1 year ago
by
Depsi
Updated special_tokens_map.json
1
#22 opened over 1 year ago
by
brandonglockaby
What are the hardware requirements for this? I am running out of memory on my RTX3060 Ti :o
2
#21 opened over 1 year ago
by
yramshev
AttributeError: 'Offload_LlamaModel' object has no attribute 'preload'
13
#17 opened over 1 year ago
by
yramshev
Attentions are all None
2
#16 opened over 1 year ago
by
joshlevy89
OSError: Error no file named pytorch_model.bin, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory models\TheBlokestable-vicuna-13B-GPTQ.
13
#14 opened over 1 year ago
by
Squeezitgirdle
some errors occured when I use the webui who can tell me why?
4
#13 opened over 1 year ago
by
yogurt111
using with transformers
2
#11 opened over 1 year ago
by
thefaheem
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64199ba2060a651c415e77e5/AViMCe0mWi_MH0Q_cv0Y1.png)
Model's VRAM Utilisation
3
#10 opened over 1 year ago
by
thefaheem
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64199ba2060a651c415e77e5/AViMCe0mWi_MH0Q_cv0Y1.png)
Unable to load it using --pre_layer flag
5
#5 opened over 1 year ago
by
boricuapab
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6344929432ccc5ca993b0d2a/SydgABP8HPPhE6zLkudmX.jpeg)
the model thinks its chatgpt, lobotomy is advised
2
#4 opened over 1 year ago
by
eucdee
No such file or directory: ‘models\TheBloke_stable-vicuna-13B-GPTQ\pytorch_model-00001-of-00003.bin’
9
#2 opened over 1 year ago
by
Blue-Devil
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/Oqk6T_U52gaDWUQITg-jb.jpeg)
stable-vicuna-13B-GPTQ-4bit.compat.no-act-order.safetensors not compatible with "standard" settings
25
#1 opened over 1 year ago
by
vmajor
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63992e59afe0d224cf2b6bf1/q2JeqTcIb5j6fUg1SWGzL.jpeg)