Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
llama-cpp
Inference Endpoints
Merge
Eval Results
text-generation-inference
AutoTrain Compatible
Mixture of Experts
Carbon Emissions
4-bit precision
8-bit precision
custom_code
text-embeddings-inference
Apply filters
Models
5,172
Full-text search
Edit filters
Sort: Trending
Active filters:
llama-cpp
Clear all
arkii/chatglm2-6b-ggml
Updated
Jul 26, 2023
•
6
pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF
Updated
Mar 29
•
7
reach-vb/phi-2-Q2_K-GGUF
Text Generation
•
Updated
Mar 27
•
4
reach-vb/TinyLlama-1.1B-Chat-v1.0-Q2_K-GGUF
Updated
Jun 19
•
20
reach-vb/TinyLlama-1.1B-Chat-v1.0-Q8_0-GGUF
Updated
Mar 27
•
3
osanseviero/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF
Updated
Mar 27
•
4
reach-vb/TinyLlama-1.1B-Chat-v1.0-Q6_K-GGUF
Updated
Mar 28
•
9
ProCreations/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF
Updated
Mar 29
ProCreations/Qwen1.5-0.5B-Q4_K_M-GGUF
Text Generation
•
Updated
Mar 29
•
6
ProCreations/Qwen1.5-4B-Q5_0-GGUF
Text Generation
•
Updated
Mar 29
•
8
jdelpino-ai/mamba-2.8b-hf-Q8_0-GGUF
Updated
Mar 30
•
1
jdelpino-ai/multi_verse_model-Q8_0-GGUF
Updated
Mar 30
•
4
•
1
gate369/mm4.star-Q5_K_S-GGUF
Updated
Mar 30
•
7
LeroyDyer/Mixtral_AI_Cyber_Dolphin-Q4_K_M-GGUF
Updated
12 days ago
•
33
•
1
LeroyDyer/Mixtral_AI_Cyber_Orca-Q4_K_M-GGUF
Updated
12 days ago
•
6
•
1
ovieyra21/BigMistral-11b-GLUED-Q8_0-GGUF
Text Generation
•
Updated
Mar 31
•
5
danielus/MermaidMixtral-3x7b-Q6_K-GGUF
Updated
Apr 2
•
5
danielus/MermaidMixtral-3x7b-Q8_0-GGUF
Updated
Apr 2
•
8
victor/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF
Updated
Apr 2
•
6
reach-vb/gemma-2b-it-Q4_K_M-GGUF
Updated
Apr 3
•
11
danielus/MermaidSolar-Q8_0-GGUF
Updated
Apr 3
•
7
danielus/MermaidSolar-Q5_K_M-GGUF
Updated
Apr 3
•
4
danielus/MermaidSolar-Q6_K-GGUF
Updated
Apr 3
•
7
danielus/MermaidSolar-Q4_K_S-GGUF
Updated
Apr 3
•
6
ggml-org/gemma-1.1-2b-it-Q8_0-GGUF
Updated
Apr 5
•
968
ggml-org/gemma-1.1-2b-it-Q4_K_M-GGUF
Updated
Apr 5
•
62
Artples/L-MChat-7b-Q4_K_M-GGUF
Text Generation
•
Updated
Apr 3
•
9
ggml-org/gemma-1.1-2b-it-Q2_K-GGUF
Updated
Apr 5
•
8
ggml-org/gemma-1.1-2b-it-Q4_0-GGUF
Updated
Apr 5
•
50
ggml-org/gemma-1.1-2b-it-Q6_K-GGUF
Updated
Apr 5
•
6
Previous
1
...
5
6
7
8
9
...
173
Next