exl2 quantization?
#1
by
musicurgy
- opened
Any chance we could get some exl2 quants of this model?
thanks
When exl2 supports Qwen, I will generate the quants. Unfortunately, not quite there yet.
Turbo's added support for Qwen models now to exl2. Generating quants now; they'll be uploaded here:
https://huggingface.co/models?search=LoneStriker%20Qwen1.5%20exl2