Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
llama-cpp
Inference Endpoints
Merge
Eval Results
text-generation-inference
AutoTrain Compatible
Mixture of Experts
Carbon Emissions
4-bit precision
8-bit precision
custom_code
text-embeddings-inference
Apply filters
Models
5,172
Full-text search
Edit filters
Sort: Trending
Active filters:
llama-cpp
Clear all
Minuano/Qwen2-7B-Instruct-Q8_0-GGUF
Text Generation
•
Updated
Jul 10
•
1
utterlygreat/omost-dolphin-2.9-llama3-8b-IQ4_XS-GGUF
Updated
Jul 10
•
55
leonn71/Mistral-7B-v0.3-Q4_K_M-GGUF
Updated
Jul 10
•
1
NikolayKozloff/ArliAI-Llama-3-8B-Formax-v1.0-Q4_0-GGUF
Updated
Jul 10
•
14
•
1
NikolayKozloff/ArliAI-Llama-3-8B-Formax-v1.0-Q5_0-GGUF
Updated
Jul 10
•
10
•
1
NikolayKozloff/ArliAI-Llama-3-8B-Formax-v1.0-IQ4_XS-GGUF
Updated
Jul 10
•
10
•
1
jinliuxi/Yi-1.5-9B-Chat-Q3_K_S-GGUF
Updated
Jul 10
NikolayKozloff/ArliAI-Llama-3-8B-Formax-v1.0-IQ4_NL-GGUF
Updated
Jul 10
•
10
•
1
adityadhakal/Meta-Llama-3-8B-Q2_K-GGUF
Text Generation
•
Updated
Jul 10
•
2
utterlygreat/omost-dolphin-2.9-llama3-8b-Q5_K_S-GGUF
Updated
Jul 10
•
10
utterlygreat/omost-dolphin-2.9-llama3-8b-Q8_0-GGUF
Updated
Jul 10
•
4
kscommhit/Llama3-ChatQA-1.5-8B-Q8_0-GGUF
Text Generation
•
Updated
Jul 10
•
2
MrRobotoAI/DnD-Campaign-Writer-8b-Q4_K_M-GGUF
Updated
Jul 10
•
23
utterlygreat/omost-dolphin-2.9-llama3-8b-Q6_K-GGUF
Updated
Jul 10
•
16
NikolayKozloff/NuminaMath-7B-TIR-Q8_0-GGUF
Text Generation
•
Updated
Jul 10
•
10
•
1
NikolayKozloff/NuminaMath-7B-TIR-Q5_0-GGUF
Text Generation
•
Updated
Jul 10
•
9
•
1
NikolayKozloff/NuminaMath-7B-TIR-Q4_0-GGUF
Text Generation
•
Updated
Jul 10
•
11
•
1
NikolayKozloff/NuminaMath-7B-TIR-IQ4_NL-GGUF
Text Generation
•
Updated
Jul 10
•
10
•
1
genevera/mistral-orthogonalized-Q5_K_S-GGUF
Updated
Jul 11
•
6
genevera/mistral-orthogonalized-Q8_0-GGUF
Updated
Jul 11
•
7
nvhf/chatgpt_paraphraser_on_T5_base-Q6_K-GGUF
Text2Text Generation
•
Updated
Jul 11
•
96
arrio/Qwen2-1.5B-Instruct-Q4_K_S-GGUF
Text Generation
•
Updated
Jul 11
arrio/Gemma-2-9B-Chinese-Chat-Q2_K-GGUF
Text Generation
•
Updated
Jul 11
•
12
yichen0104/ReluLLaMA-7B-Q4_K_M-GGUF
Updated
Jul 11
•
6
Fizzarolli/writer-8b-Q4_K_S-GGUF
Updated
Jul 11
•
13
mchl914/Llama-3-Taiwan-8B-Instruct-Q8_0-GGUF
Text Generation
•
Updated
Jul 11
•
4
mchl914/Llama3-TAIDE-LX-8B-Chat-Alpha1-Q8_0-GGUF
Updated
Jul 11
•
9
qizc/Phi-3-mini-4k-instruct-Q2_K-GGUF
Text Generation
•
Updated
Jul 11
•
1
MisterSP/AlphaMist7B-slr-v4-slow2-Q4_K_M-GGUF
Updated
Jul 11
•
7
•
1
martintomov/Qwen2-7B-Instruct-Q4_K_M-GGUF
Text Generation
•
Updated
Jul 11
•
6
Previous
1
...
103
104
105
106
107
...
173
Next