feelconstantfear
/

gemma-2-2b-it-abliterated-GPTQ-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Edit model card

feelconstantfear/gemma-2-2b-it-abliterated-GPTQ-4bit

Model: gemma-2-2b-it-abliterated
Made by: IlyaGusev

Quantization notes

Made with GPTQ with the c4 dataset.

Downloads last month: 20

Safetensors

Model size

861M params

Tensor type

I32

·

FP16

·

Inference Examples

Text Generation

Inference API (serverless) is not available, repository is disabled.

Model tree for feelconstantfear/gemma-2-2b-it-abliterated-GPTQ-4bit

Base model

IlyaGusev/gemma-2-2b-it-abliterated

Quantized

this model