Spaces:

upstage

/

open-ko-llm-leaderboard

like 441

Running on CPU Upgrade

Hello, I get the below error.

File "~/transformers/models/mistral/modeling_mistral.py", line 353, in forward
and kv_seq_len > self.config.sliding_window
TypeError: '>' not supported between instances of 'int' and 'NoneType'

(Looks like this bug might have been fixed in the latest update of the transformers library, so I'll update the version and give it retry.)

It appears that there is a bug in the transformers.
It seems to have been resolved in the latest version. (Fix sliding_window hasattr in Mistral)
I temporarily changed the sliding_window value of the config.json file to null -> 4096 and resubmitted it.

@JeongwonChoi
v1 and Edentns/DataVortexM-7B-Instruct-v0.2 is same model? i run the v1 directly. if the model is same, can i remove v2?

@choco9966
Yes, v1 and v2 are the same model and only changed the name.
It's okay to remove it.

Hello, can I check the error of the Edentns/DataVortexS-10.7B-v0.1 model?
When I checked it in the morning, it seemed to keep working.

@JeongwonChoi Your model not failed.

I'm sorry. I think I misread it or there was a bug.
Thank you for your confirmation.