Moses25
/

Mistral-7B-Instruct-32K-GPTQ-INT8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-32K-GPTQ-INT8 / gptq_model-8bit-128g.safetensors

Commit History

add models

b1f4b95

Moses25 commited on Jun 5