Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

69

Full-text search

Active filters: llama.cpp

google/gemma-2-2b-it-GGUF

Updated Aug 27 • 710 • 70

LPN64/LongCite-llama3.1-8b-GGUF

Text Generation • Updated 5 days ago • 843 • 3

mys/ggml_llava-v1.5-7b

Updated Oct 9, 2023 • 24.7k • 103

google/gemma-7b-it-GGUF

Updated Aug 14 • 19 • 40

webbigdata/C3TR-Adapter_gguf

Translation • Updated Aug 14 • 1.06k • 20

google/codegemma-2b-GGUF

Text Generation • Updated Jun 27 • 34 • 20

google/codegemma-7b-it-GGUF

Text Generation • Updated Jun 27 • 35 • 49

openbmb/MiniCPM-Llama3-V-2_5-gguf

Updated Aug 19 • 11.8k • 205

google/gemma-2-2b-GGUF

Updated Aug 2 • 91 • 13

Mozzipa/ko_vicuna_7b_ggml_q4

Updated Apr 20, 2023 • 4

ManthanKulakarni/JQL_LLaMa_GGML

Text Generation • Updated Jun 26, 2023 • 2

mys/ggml_llava-v1.5-13b

Updated Oct 10, 2023 • 6.74k • 51

mys/ggml_bakllava-1

Updated Oct 19, 2023 • 8.55k • 74

wasmedge/llama2

Text Generation • Updated Nov 11, 2023 • 305 • 9

alvarobartt/lince-zero-7b-GGUF

Text Generation • Updated Nov 1, 2023 • 37

vietgpt/dama-2-7b-chat-gguf

Text Generation • Updated Nov 17, 2023 • 43 • 1

FlexingD/yarn-mistral-7B-64k-instruct-alpaca-cleaned-GGUF

Updated Dec 4, 2023 • 467 • 5

jdluzen/Mistral-7B-Instruct-v0.2-GGUF

Updated Dec 24, 2023 • 46

mostafaamiri/persian-llama-7b-GGUF-Q4

Updated Jan 13 • 68 • 9

ayoubkirouane/Mistral-Depth-UP-Scaled-9B-AlpacaInstruct-gguf

Text Generation • Updated Jan 24 • 60

ehristoforu/LLMs

Text Generation • Updated Apr 16 • 13 • 4

osanseviero/DareVox-7B-AWQ

Updated Feb 7 • 1

IndiaBuild/GGUF_Navarna_v0_1_OpenHermes_Hindi

Updated Feb 15 • 11

ahmetkca/trendyol-7B-v1.0-f16-gguf

Updated Feb 15 • 22

ahmetkca/trendyol-7B-v1.0-f32-gguf

Updated Feb 15 • 28

google/gemma-7b-GGUF

Updated Jun 27 • 25 • 16

google/gemma-2b-it-GGUF

Updated Jun 27 • 21 • 11

google/gemma-2b-GGUF

Updated Jun 27 • 51 • 9

iAkashPaul/Indic-gemma-2b-finetuned-sft-Navarasa-GGUF

Updated Mar 8 • 43 • 3

MrOvkill/gemma-2-inference-endpoint-GGUF

Text Generation • Updated Mar 11 • 9