unsloth
/

llama-2-7b-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

shimmyshimmer commited on Mar 22

Commit

33c7b76

•

1 Parent(s): 1e9c845

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -15,6 +15,7 @@ tags:
 # Finetune Mistral, Gemma, Llama 2-5x faster with 70% less memory via Unsloth!
 Directly quantized 4bit model with `bitsandbytes`.
 We have a Google Colab Tesla T4 notebook for Llama 7b here: https://colab.research.google.com/drive/1lBzz5KeZJKXjvivbYvmGarix9Ao6Wxe5?usp=sharing
 [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/Discord%20button.png" width="200"/>](https://discord.gg/u54VK8m8tk)

 # Finetune Mistral, Gemma, Llama 2-5x faster with 70% less memory via Unsloth!
 Directly quantized 4bit model with `bitsandbytes`.
 We have a Google Colab Tesla T4 notebook for Llama 7b here: https://colab.research.google.com/drive/1lBzz5KeZJKXjvivbYvmGarix9Ao6Wxe5?usp=sharing
 [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/Discord%20button.png" width="200"/>](https://discord.gg/u54VK8m8tk)