Beware! Requires new cuda.
13
#5 opened over 1 year ago
by
autobots
![](https://cdn-avatars.huggingface.co/v1/production/uploads/63f26d8a7ddf724fbcc274a0/hoCyIEo1UvOJnqaNOpVAh.jpeg)
Getting size mismatch for model.layers with alpaca-lora-65B-GPTQ-4bit-1024g.safetensors
4
#3 opened over 1 year ago
by
GeoBuilder
Error in instructions?
1
#2 opened over 1 year ago
by
Co0ode
![](https://cdn-avatars.huggingface.co/v1/production/uploads/61ddb82cc59d602a3a85afb1/AmEj4WwRmxz1v7YWDm3f-.png)
It also works on Windows, using last update of the CUDA GPTQ tree.
1
#1 opened over 1 year ago
by
BGLuck