TheBloke

/

Qwen-7B-Chat-GPTQ

like 2

Now LLaMA.cpp supports Qwen
https://github.com/ggerganov/llama.cpp/pull/4281

Here is a series of qwen models.(The support of 1.8B model is not checked.)
https://huggingface.co/Qwen/Qwen-72B-Chat
https://huggingface.co/Qwen/Qwen-14B-Chat
https://huggingface.co/Qwen/Qwen-7B-Chat
https://huggingface.co/Qwen/Qwen-1_8B-Chat
https://huggingface.co/Qwen/Qwen-Audio-Chat
https://huggingface.co/Qwen/Qwen-VL-Chat

Maybe Internlm? https://github.com/ggerganov/llama.cpp/pull/4283

https://huggingface.co/internlm/internlm-chat-20b
https://huggingface.co/internlm/internlm-chat-7b-v1_1