Edit Models filters

text-generation-inference

4-bit precision

8-bit precision

AutoTrain Compatible

Inference Endpoints

Mixture of Experts

Other with no match

text-embeddings-inference

Carbon Emissions

Models

1,128

Full-text search

Active filters: GGUF

legraphista/gemma-2-27b-it-IMat-GGUF

Text Generation • Updated 5 days ago • 136k • 14

legraphista/glm-4-9b-chat-1m-GGUF

Text Generation • Updated 15 days ago • 15.9k • 14

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 494k • 49

legraphista/glm-4-9b-chat-GGUF

Text Generation • Updated 15 days ago • 17.1k • 8

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • Updated May 10 • 263 • 6

legraphista/llm-compiler-13b-IMat-GGUF

Text Generation • Updated 8 days ago • 48.8k • 3

Mozilla/llava-v1.5-7b-llamafile

Updated 4 days ago • 6.91k • 158

Trelis/openchat_3.5-function-calling-v3

Text Generation • Updated Mar 6 • 19

Mozilla/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated 4 days ago • 200 • 9

tsunemoto/LiteLlama-460M-1T-GGUF

Updated Jan 7 • 579 • 5

vicgalle/solarized-18B-dpo-GGUF

Updated Jan 20 • 122 • 3

vicgalle/solarized-13B-dpo-GGUF

Updated Jan 20 • 57 • 2

tsunemoto/TinyDolphin-2.8-1.1b-GGUF

Updated Jan 22 • 349 • 5

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Jan 30 • 239 • 5

seyf1elislam/neural-Kunoichi2-7B-slerp-GGUF

Updated Feb 1 • 79 • 3

MaziyarPanahi/CodeLlama-34b-Instruct-hf-GGUF

Text Generation • Updated Feb 1 • 213 • 1

MaziyarPanahi/BioMistral-7B-DARE-GGUF

Text Generation • Updated Feb 19 • 170 • 2

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28 • 699 • 7

seyf1elislam/Kuno-lake-slerp-7b-GGUF

Updated Mar 6 • 108 • 1

MaziyarPanahi/MixTAO-7Bx2-MoE-v8.1-GGUF

Text Generation • Updated Mar 11 • 578 • 11

ilsp/Meltemi-7B-Instruct-v1-GGUF

Updated Apr 18 • 16 • 13

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 2.18k • 109

abhinand/Meta-Llama-3-8B-GGUF

Text Generation • Updated Apr 18 • 47 • 1

LiteLLMs/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 18 • 526 • 1

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated 7 days ago • 15.9k • 55

legraphista/RoMistral-7b-Instruct-GGUF

Text Generation • Updated May 23 • 214 • 2

LiteLLMs/Mistral-7B-Instruct-v0.3-GGUF

Updated May 23 • 492 • 1

legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF

Text Generation • Updated May 26 • 3.64k • 5

legraphista/Phi-3-medium-128k-instruct-IMat-GGUF

Text Generation • Updated May 26 • 2.35k • 1

legraphista/Llama3-ChatQA-1.5-8B-IMat-GGUF

Text Generation • Updated May 27 • 2.04k • 1