Important Information About this model (Q8)

#3
by karmikovic - opened

I have thoroughly tested many models. This model strangely scored 2nd to the lowest among models from the past year. Very strange and unexpected results. Retested many times. Something is wrong with it. You've been warned!

P.S. if you are the creator of this model please test Quant8. For sample fails try this:
5+5=?

If you ask it anything more difficult it will get it more wrong than it gets 5+5. (Absolutely shocked at the extreme low performance).

Oh, you wanna know which model is performing highest in our tests? LEXI uncensored so far is nearly over 25% lead over ALL tested models 8b and lower.

What am we testing them with?
Reasoning, creative writing, math, instruction following and out of the box thinking.

If you find a better model that LEXI 8b or lower, please share as i have. ;)

I have thoroughly tested many models. This model strangely scored 2nd to the lowest among models from the past year. Very strange and unexpected results. Retested many times. Something is wrong with it. You've been warned!

P.S. if you are the creator of this model please test Quant8. For sample fails try this:
5+5=?

If you ask it anything more difficult it will get it more wrong than it gets 5+5. (Absolutely shocked at the extreme low performance).

Oh, you wanna know which model is performing highest in our tests? LEXI uncensored so far is nearly over 25% lead over ALL tested models 8b and lower.

What am we testing them with?
Reasoning, creative writing, math, instruction following and out of the box thinking.

If you find a better model that LEXI 8b or lower, please share as i have. ;)

So just now, at the 8B size range, what's the top models you have tested, please ? Thank you so much. πŸ™πŸ‘πŸ’₯

Sign up or log in to comment