vLLM

#2
by fullstack - opened

I tried this model and the coder one, this one fail in vLLM and coder 7bgives strange output

Qwen org

Hi, take a look at this part of the modelcard
image.png

you need to use "-instruct" ones

jklj077 changed discussion status to closed

Sign up or log in to comment