GGUF
#1
by
Ttimofeyka
- opened
Can you publish GGUF-quantized files? I see them in your profile for older versions, but not for the latest one.
Yeah no worries - just finished π, just wasn't sure if anyone was interested in them.
jsfs11
changed discussion status to
closed
In theory, according to benchmarks, this is about the best 4x7B model for chat (RP).