Felladrin/TinyMistral-248M-Evol-Instruct-GGUF
Quantized GGUF model files for TinyMistral-248M-Evol-Instruct from Felladrin
| Name | Quant method | Size |
|---|---|---|
| tinymistral-248m-evol-instruct.q2_k.gguf | q2_k | 115.26 MB |
| tinymistral-248m-evol-instruct.q3_k_m.gguf | q3_k_m | 130.08 MB |
| tinymistral-248m-evol-instruct.q4_k_m.gguf | q4_k_m | 155.67 MB |
| tinymistral-248m-evol-instruct.q5_k_m.gguf | q5_k_m | 179.23 MB |
| tinymistral-248m-evol-instruct.q6_k.gguf | q6_k | 204.26 MB |
| tinymistral-248m-evol-instruct.q8_0.gguf | q8_0 | 264.32 MB |
Original Model Card:
Locutusque's TinyMistral-248M trained on the Evol Instruct dataset using AutoTrain
- Base model: Locutusque/TinyMistral-248M
- Dataset: KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
- Training: 9.5h under these parameters
Recommended Prompt Format
### Instruction:
<instruction>
### Response:
- Downloads last month
- 92
Inference API (serverless) has been turned off for this model.