Neurai
/

NeuraOrcaGemma7b

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Neura commited on Mar 29

Commit

90f5f84

•

1 Parent(s): 3462012

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -51,7 +51,7 @@ make sure these packages are installed:
 from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
 import torch
 import os
-MODEL_PATH = "Neurai/NeuraGemma"
 quantization_config = BitsAndBytesConfig(
     load_in_4bit = True,
     bnb_4bit_quant_type="nf4",

 from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
 import torch
 import os
+MODEL_PATH = "Neurai/NeuraOrcaGemma7b"
 quantization_config = BitsAndBytesConfig(
     load_in_4bit = True,
     bnb_4bit_quant_type="nf4",