Want to ask a general question
#5
by
ardha27
- opened
hi, can i ask a general question? what is the main different of GGUF models and it's original models? what is the pros and cons?
The GGUF versions are smaller than the larger original models and will fit in lower VRAM requirements.
Cons - speed might be slower in some cases+ the lower you go in the Q, the lower the quality.