fblgit

/

UNA-ThePitbull-21.4B-v2

like 15

Greetings,
The prompt format seems to strongly affect the behavior of this; I've had reasonably good luck using ChatML format, but I feel like it's just a little off. I've been using the Q8 and Q6 versions, so I'm going to try the unquantized today and see if ChatML works okay with it.

But generally it's super-valuable to include the prompt format if possible.

Thanks muchly!

-- Cypherfox