Mistral-7B-v0.1-GPTQ-8bit-g64 / quantize_config.json

Commit History

AutoGPTQ model for mistralai/Mistral-7B-v0.1: 8bits, gr64, desc_act=False
e3a5cbc
verified

iproskurina commited on