UCLA-EMC
/

Meta-Llama-3.1-8B-AWQ-INT4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

clearcash commited on Aug 10

Commit

e7ebe1f

•

1 Parent(s): ab6c6ec

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -44,7 +44,7 @@ from google.colab import userdata
 my_token = userdata.get("HF_TOKEN")
 login(my_token)
-model_name = "clearcash/Llama-3.1-8B-AWQ-INT4"
 quantization_config = AwqConfig(
 bits=4,

 my_token = userdata.get("HF_TOKEN")
 login(my_token)
+model_name = "UCLA-EMC/Meta-Llama-3.1-8B-AWQ-INT4"
 quantization_config = AwqConfig(
 bits=4,