mradermacher
/

Mixtral-8x7B-Holodeck-v1-i1-GGUF

Mixture of Experts

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on May 7

Commit

f2bf731

•

1 Parent(s): 65c35ae

auto-patch README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -29,6 +29,7 @@ more details, including on how to concatenate multi-part files.
 | Link | Type | Size/GB | Notes |
 |:-----|:-----|--------:|:------|
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 10.1 | for the desperate |
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 12.8 |  |
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 14.2 |  |
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 14.4 |  |

 | Link | Type | Size/GB | Notes |
 |:-----|:-----|--------:|:------|
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 10.1 | for the desperate |
+| [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 10.8 | mostly desperate |
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 12.8 |  |
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 14.2 |  |
 | [GGUF](https://huggingface.co/mradermacher/Mixtral-8x7B-Holodeck-v1-i1-GGUF/resolve/main/Mixtral-8x7B-Holodeck-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 14.4 |  |