Edit Models filters

text-generation-inference

4-bit precision

8-bit precision

AutoTrain Compatible

Inference Endpoints

Mixture of Experts

Other with no match

text-embeddings-inference

Carbon Emissions

Models

1,130

Full-text search

Active filters: GGUF

legraphista/RoGemma-7b-Instruct-IMat-GGUF

Text Generation • Updated 12 days ago • 40k

legraphista/Llama-3-Instruct-8B-SPPO-Iter3-IMat-GGUF

Text Generation • Updated 12 days ago • 21.6k

MaziyarPanahi/Qwen2-7B-Instruct-v0.1-GGUF

Text Generation • Updated 12 days ago • 9.68k

MaziyarPanahi/Qwen2-7B-Instruct-v0.2-GGUF

Text Generation • Updated 12 days ago • 7.95k

MaziyarPanahi/Qwen2-7B-Instruct-v0.3-GGUF

Text Generation • Updated 12 days ago • 8.81k • 1

legraphista/Yi-9B-Coder-IMat-GGUF

Text Generation • Updated 12 days ago • 25.9k

MaziyarPanahi/Qwen2-7B-Instruct-v0.4-GGUF

Text Generation • Updated 12 days ago • 8.17k

legraphista/gemma-2-9b-it-IMat-GGUF

Text Generation • Updated 9 days ago • 52.2k • 2

MaziyarPanahi/Qwen2-7B-Instruct-v0.5-GGUF

Text Generation • Updated 11 days ago • 6.22k

MaziyarPanahi/Qwen2-7B-Instruct-v0.6-GGUF

Text Generation • Updated 11 days ago • 13.5k

MaziyarPanahi/Qwen2-7B-Instruct-v0.7-GGUF

Text Generation • Updated 11 days ago • 9.43k

MaziyarPanahi/Qwen2-7B-Instruct-v0.8-GGUF

Text Generation • Updated 11 days ago • 5.4k • 1

legraphista/llm-compiler-7b-IMat-GGUF

Text Generation • Updated 11 days ago • 19.9k

legraphista/llm-compiler-7b-ftd-IMat-GGUF

Text Generation • Updated 11 days ago • 25.6k • 1

legraphista/llm-compiler-13b-ftd-IMat-GGUF

Text Generation • Updated 11 days ago • 29.2k

olonok/phi-3-mini-4k-instruct-q8_0-gguf

Updated 8 days ago

legraphista/Phi-3.1-mini-4k-instruct-IMat-GGUF

Text Generation • Updated 6 days ago • 242

legraphista/internlm2_5-7b-chat-IMat-GGUF

Text Generation • Updated 5 days ago • 550

LiteLLMs/OpenELM-1_1B-Instruct-GGUF

Updated 2 days ago • 105

kunci115/llama3-finetuned-conversational-Q4-GGUF

Text Generation • Updated about 23 hours ago