BlackSamorez
/

Mixtral-8x7b-AQLM-2Bit-1x16-hf-test-dispatch

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Mixtral-8x7b-AQLM-2Bit-1x16-hf-test-dispatch / README.md

BlackSamorez's picture

Update README.md

9097cc5 verified 7 months ago

|

history blame contribute delete

No virus

284 Bytes

WARNING: this checkpoint might be obsolete. Please use the updated Mixtral checkpoint.

Official AQLM quantization of mistralai/Mixtral-8x7B-v0.1.