is this filtered or unfiltered can it run on my 3090?
#4 opened 6 months ago
by
Avos0001
32k ctx doesn't work on this model for GGUF
#3 opened 6 months ago
by
danieloneill
![](https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/q10XazjtMbOqWgQQK5UcN.png)
Using the new gguf quant method may result in a worse overall performance than that of the old gguf quants.
#2 opened 8 months ago
by
TheYuriLover
Requesting IQ2_XXS and IQ2_XS quants.
#1 opened 8 months ago
by
benxh