Hugging Face's logo

Kooten
/
MiquMaid-v1-70B-IQ2-GGUF

GGUF
Inference Endpoints
Model card Files Community
2
Kooten commited on
Commit
fc0c0d3
•
1 Parent(s): 1747456

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -3,7 +3,7 @@
3
  ## Description
4
  2bit imatrix GGUF quants of [NeverSleep/MiquMaid-v1-70B](https://huggingface.co/NeverSleep/MiquMaid-v1-70B)
5
 
6
- Imatrix generated from q8 of MiquMaid, 2000 chunks at 500 ctx. Dataset was Wikitext.
7
 
8
  ## Other quants:
9
  EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
 
3
  ## Description
4
  2bit imatrix GGUF quants of [NeverSleep/MiquMaid-v1-70B](https://huggingface.co/NeverSleep/MiquMaid-v1-70B)
5
 
6
+ [Imatrix](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF/blob/main/Imatrix/imatrix-MiquMaid-c2000-ctx500-wikitext.dat) generated from q8 of MiquMaid, 2000 chunks at 500 ctx. Dataset was Wikitext.
7
 
8
  ## Other quants:
9
  EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)