altomek
/

mistral-nemo-gutenberg-12B-v3-8bpw-EXL2

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

Edit model card

mistral-nemo-gutenberg-12B-v3

ExLlamav2 8 bpw quants of https://huggingface.co/nbeerbower/mistral-nemo-gutenberg-12B-v3

Downloads last month: 9

Inference Examples

Text Generation

Inference API (serverless) has been turned off for this model.

Model tree for altomek/mistral-nemo-gutenberg-12B-v3-8bpw-EXL2

Base model

intervitens/mini-magnum-12b-v1.1

Finetuned

nbeerbower/mistral-nemo-gutenberg-12B-v3

Quantized

(4)

this model

Dataset used to train altomek/mistral-nemo-gutenberg-12B-v3-8bpw-EXL2