New Exciting quant method
2
#3 opened 7 months ago
by
Yhyu13
KeyError: 'mixtral'
1
#2 opened 7 months ago
by
MohamedBerrimi
![](https://cdn-avatars.huggingface.co/v1/production/uploads/1632603679543-6030cba7d2c57896177ce75e.png)
How is the performance of the model with 2bits only?
1
#1 opened 7 months ago
by
DrNicefellow
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5f2220612128ba01bdf08c26/PTAD_Zcdq_O91DfYaDpNW.png)