Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

3,058

Full-text search

Active filters: gguf-my-repo

NikolayKozloff/llama-3-llamilitary-Q8_0-GGUF

Updated 2 days ago • 24 • 3

raincandy-u/TinyStories-656K-Q8_0-GGUF

Updated 23 days ago • 6 • 2

SteelQuants/L3-Aethora-15B-V2-Q6_K-GGUF

Updated 9 days ago • 4.68k • 2

NikolayKozloff/Solar-Ko-Recovery-11B-Q8_0-GGUF

Text Generation • Updated 4 days ago • 4.18k • 2

NikolayKozloff/Solar-Ko-Recovery-11B-Q6_K-GGUF

Text Generation • Updated 4 days ago • 4.07k • 2

NikolayKozloff/dictalm2-it-qa-fine-tune-Q8_0-GGUF

Text Generation • Updated 3 days ago • 1.48k • 2

NikolayKozloff/gemma2-9B-sunfall-v0.5-Q8_0-GGUF

Text Generation • Updated 1 day ago • 14 • 2

impactframes/Octopus-v2-Q4_K_M-GGUF

Updated Apr 6 • 31 • 2

DavidAU/RolePlayLake-7B-Q6_K-GGUF

Updated Apr 10 • 29 • 1

boxomcfoxo/YiffyEstopianMaid-13B-GGUF

Updated Apr 19 • 197 • 2

ehristoforu/Gistral-16B-Q4_K_M-GGUF

Text Generation • Updated Apr 21 • 21 • 4

hus960/Unholy-Aura-Llama-3-8B-Q4_K_M-GGUF

Updated Apr 24 • 29 • 1

apitchai/Mixtral-8x7B-Instruct-v0.1-Q4_0-GGUF

Updated Apr 24 • 131 • 1

gate369/llama-lexi-star-uncensored-8b-slerp-Q4_K_M-GGUF

Updated Apr 27 • 30 • 1

hus960/Lelanta-lake-7b-Q4_K_M-GGUF

Updated Apr 27 • 15 • 1

int2eh/llama-3-8B-Instruct-function-calling-v0.2-Q6_K-GGUF

Updated May 1 • 47 • 1

igorbkz/gpt2-Q8_0-GGUF

Updated May 4 • 256 • 2

YorkieOH10/Llama-3-8B-LexiFun-Uncensored-V1-Q8_0-GGUF

Updated May 6 • 38 • 1

YorkieOH10/GPT-NeoX-20B-Erebus-Q8_0-GGUF

Updated May 7 • 545 • 2

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated 3 days ago • 2.27k • 30

NikolayKozloff/SFR-Iterative-DPO-LLaMA-3-8B-R-Q8_0-GGUF

Updated May 14 • 32 • 4

djward888/SFR-Iterative-DPO-LLaMA-3-8B-R-Q6_K-GGUF

Updated May 14 • 27 • 1

newsletter/NinjaMouse-2.4B-32L-danube-Q6_K-GGUF

Updated May 14 • 20 • 1

newsletter/h2o-danube2-1.8b-chat-Q6_K-GGUF

Text Generation • Updated May 14 • 28 • 1

Sagicc/SFR-Iterative-DPO-LLaMA-3-8B-R-Q4_K_M-GGUF

Updated May 15 • 7.8k • 1

openerotica/Llama-3-lima-nsfw-16k-test-GGUF

Updated May 17 • 366 • 1

cminja/SFR-Iterative-DPO-LLaMA-3-8B-R-Q4_K_M-GGUF

Updated May 21 • 45 • 1

cminja/SFR-Iterative-DPO-LLaMA-3-8B-R-Q8_0-GGUF

Updated May 21 • 39 • 1

cminja/Llama-3-8B-Lexi-Uncensored-Q8_0-GGUF

Updated May 19 • 56 • 1

kpkiosk66/L3-8B-Stheno-v3.1-Q8_0-GGUF

Updated May 20 • 40 • 4