Qwen
/

Qwen2.5-72B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

jklj077 commited on about 1 month ago

Commit

b0e2b4a

•

1 Parent(s): 2e7d7cc

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -60,8 +60,8 @@ Since cloning the entire repo may be inefficient, you can manually download the
 For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
 ```shell
-./llama-cli -m qwen2.5-72b-instruct-q5_k_m.gguf \
-    -co -cnv -p "You are a helpful assistant." \
     -fa -ngl 80 -n 512
 ```

 For users, to achieve chatbot-like experience, it is recommended to commence in the conversation mode:
 ```shell
+./llama-cli -m <gguf-file-path> \
+    -co -cnv -p "You are Qwen, created by Alibaba Cloud. You are a helpful assistant." \
     -fa -ngl 80 -n 512
 ```