README.md

MiquMaid-v1-70B IQ2

Description

2bit imatrix GGUF quants of NeverSleep/MiquMaid-v1-70B

Imatrix generated from q8 of MiquMaid, 2000 chunks at 500 ctx. Dataset was Wikitext.

Other quants:

EXL2: 3.5bpw, 3bpw, 2.4bpw

GGUF:

2bit Imatrix GGUF

NeverSleeps Official Quants

Custom format:

### Instruction:
{system prompt}

### Input:
{input}

### Response:
{reply}

Contact

Kooten on discord