Duxiaoman-DI
/

XuanYuan-6B-Chat-8bit

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

homeyang commited on Mar 16

Commit

ca245d0

•

1 Parent(s): adaf95e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -42,7 +42,7 @@ XuanYuan-6B基座模型、chat模型及其量化模型的使用方法和[XuanYua
 import torch
 from transformers import LlamaForCausalLM, AutoTokenizer
-model_name_or_path = "Duxiaoman-DI/XuanYuan-6B-Chat"
 tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
 model = LlamaForCausalLM.from_pretrained(model_name_or_path, device_map="auto")

 import torch
 from transformers import LlamaForCausalLM, AutoTokenizer
+model_name_or_path = "your/model/path/"
 tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
 model = LlamaForCausalLM.from_pretrained(model_name_or_path, device_map="auto")