Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

6,914

Full-text search

Active filters: llama-cpp

ClaudioItaly/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q4_K_M-GGUF

Updated 14 days ago • 20 • 1

byroneverson/Mistral-Small-Instruct-2409-abliterated-gguf

Text Generation • Updated 14 days ago • 50 • 3

bunnycore/Qwen2.5-7B-TitanFusion-IQ4_XS-GGUF

Updated 14 days ago • 4 • 1

NikolayKozloff/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q8_0-GGUF

Updated 13 days ago • 14 • 1

Etherll/Qwen2.5-14b-web-Q6_K-GGUF

Updated 13 days ago • 12 • 1

NikolayKozloff/Vikhr-Llama3.1-8B-Instruct-R-21-09-24-Q8_0-GGUF

Updated 13 days ago • 42 • 1

Lambent/qwen2.5-reinstruct-alternate-lumen-14B-Q4_K_M-GGUF

Updated 13 days ago • 32 • 1

Elfrino/XwinXtended-20B-Q4_K_M-GGUF

Updated 11 days ago • 19 • 1

NikolayKozloff/EuroLLM-1.7B-Q8_0-GGUF

Updated 12 days ago • 417 • 1

Elfrino/XwinXtended-20B-Q8_0-GGUF

Updated 11 days ago • 14 • 1

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 8.79k • 7

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 11 days ago • 23 • 1

aashish1904/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 17 • 1

jxtngx/Meta-Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 192 • 1

aashish1904/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 89 • 1

polyverse/Llama-3.2-3B-Q5_K_M-GGUF

Text Generation • Updated 11 days ago • 71 • 1

Elfrino/LiquidCrystal_V3-20B-Q5_K_M-GGUF

Updated 11 days ago • 12 • 1

Solshine/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 100 • 1

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 32 • 1

Orion-zhen/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

Text Generation • Updated 11 days ago • 365 • 1

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated 11 days ago • 28 • 1

NikolayKozloff/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 11 days ago • 32 • 1

NikolayKozloff/Llama-3.2-1B-Q8_0-GGUF

Text Generation • Updated 11 days ago • 24 • 1

NikolayKozloff/Llama-3.2-3B-Q8_0-GGUF

Text Generation • Updated 11 days ago • 49 • 1

NikolayKozloff/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated 11 days ago • 70 • 2

NikolayKozloff/polanka-qwen2-1.5b-v0.1-ckpt_401000-Q8_0-GGUF

Updated 11 days ago • 12 • 1

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 10 days ago • 77 • 1

NikolayKozloff/EuroLLM-1.7B-Instruct-Q8_0-GGUF

Updated 10 days ago • 20 • 1

NikolayKozloff/T-lite-instruct-0.1-Q8_0-GGUF

Updated 10 days ago • 13 • 1

NikolayKozloff/T-lite-instruct-0.1-Q6_K-GGUF

Updated 10 days ago • 9 • 1