Hugging Face's logo

jarrelscy
/
Mixtral-8x22B-Instruct-v0.1-GPTQ-4bit

Text Generation
Transformers
Safetensors
mixtral
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
3
Edit model card

Model Card for Model ID

Optimum GPTQ quantized 8-bit version of Mixtral-8x22B-Instruct-v0.1
See original model card for more information.

How to load

Downloads last month
262
Safetensors
Model size
19.2B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.