Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Granther
/
Gemma-2-9B-Instruct-4Bit-GPTQ
like
0
Text Generation
Transformers
Safetensors
gemma2
conversational
Inference Endpoints
text-generation-inference
4-bit precision
gptq
License:
mit
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
Edit model card
README.md exists but content is empty. Use the
Edit model card
button to edit it.
Downloads last month
46
Safetensors
Model size
2.03B params
Tensor type
I32
·
FP16
·
Inference API
Text Generation
Examples
Input a message to start chatting with
Granther/Gemma-2-9B-Instruct-4Bit-GPTQ
.
Send
This model can be loaded on Inference API (serverless).
JSON Output
Maximize