Hugging Face's logo

afrideva
/
TinyMistral-248M-Evol-Instruct-GGUF

Text Generation
GGUF
Trained with AutoTrain
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community
afrideva commited on
Commit
abde726
•
1 Parent(s): 233ca15

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -40,14 +40,14 @@ widget:
40
 
41
  ### Response:'
42
  ---
43
- # Felladrin/TinyMistral-248M-Evol-Instruct-GGUF
44
 
45
- Quantized GGUF model files for [TinyMistral-248M-Evol-Instruct](https://huggingface.co/Felladrin/TinyMistral-248M-Evol-Instruct) from [Felladrin](https://huggingface.co/Felladrin)
46
 
47
 
48
- | Name | Quant method | Size |
49
- | ---- | ---- | ---- |
50
- | [tinymistral-248m-evol-instruct.fp16.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.fp16.gguf) | fp16 | 496.82 MB |
51
  | [tinymistral-248m-evol-instruct.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q2_k.gguf) | q2_k | 115.26 MB |
52
  | [tinymistral-248m-evol-instruct.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q3_k_m.gguf) | q3_k_m | 130.08 MB |
53
  | [tinymistral-248m-evol-instruct.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q4_k_m.gguf) | q4_k_m | 155.67 MB |
@@ -55,7 +55,7 @@ widget:
55
  | [tinymistral-248m-evol-instruct.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q6_k.gguf) | q6_k | 204.26 MB |
56
  | [tinymistral-248m-evol-instruct.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q8_0.gguf) | q8_0 | 264.32 MB |
57
 
58
-
59
 
60
  ## Original Model Card:
61
  # Locutusque's TinyMistral-248M trained on the Evol Instruct dataset using AutoTrain
 
40
 
41
  ### Response:'
42
  ---
43
+ # Felladrin/TinyMistral-248M-Evol-Instruct-GGUF
44
 
45
+ Quantized GGUF model files for [TinyMistral-248M-Evol-Instruct](https://huggingface.co/Felladrin/TinyMistral-248M-Evol-Instruct) from [Felladrin](https://huggingface.co/Felladrin)
46
 
47
 
48
+ | Name | Quant method | Size |
49
+ | ---- | ---- | ---- |
50
+ | [tinymistral-248m-evol-instruct.fp16.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.fp16.gguf) | fp16 | 496.82 MB |
51
  | [tinymistral-248m-evol-instruct.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q2_k.gguf) | q2_k | 115.26 MB |
52
  | [tinymistral-248m-evol-instruct.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q3_k_m.gguf) | q3_k_m | 130.08 MB |
53
  | [tinymistral-248m-evol-instruct.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q4_k_m.gguf) | q4_k_m | 155.67 MB |
 
55
  | [tinymistral-248m-evol-instruct.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q6_k.gguf) | q6_k | 204.26 MB |
56
  | [tinymistral-248m-evol-instruct.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Evol-Instruct-GGUF/resolve/main/tinymistral-248m-evol-instruct.q8_0.gguf) | q8_0 | 264.32 MB |
57
 
58
+
59
 
60
  ## Original Model Card:
61
  # Locutusque's TinyMistral-248M trained on the Evol Instruct dataset using AutoTrain