-
-
-
-
-
-
Inference status
Active filters:
4bit
legraphista/Reflection-Llama-3.1-70B-IMat-GGUF
Text Generation
•
Updated
•
8
legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF
Text Generation
•
Updated
•
635
•
5
speakleash/Bielik-11B-v2.2-Instruct-MLX-4bit
Text Generation
•
Updated
•
45
•
3
speakleash/Bielik-11B-v2.2-Instruct-Quanto-4bit
Text Generation
•
Updated
•
44
•
3
alexwww94/glm-4v-9b-gptq-4bit
Updated
•
191
•
2
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation
•
Updated
•
7.01k
•
1
legraphista/glm-4-9b-chat-GGUF
Text Generation
•
Updated
•
7.61k
•
16
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
•
Updated
•
326
•
2
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
•
Updated
•
2.7k
•
20
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
•
Updated
•
851
•
2
ModelCloud/gemma-2-27b-it-gptq-4bit
Text Generation
•
Updated
•
1.73k
•
7
ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit
Text Generation
•
Updated
•
1.07k
•
3
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
•
Updated
•
2.08k
•
26
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
•
Updated
•
4.45k
•
12
legraphista/Minitron-8B-Base-GGUF
Text Generation
•
Updated
•
829
•
1
0xroyce/Plutus-Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation
•
Updated
•
404
•
1
jhangmez/CHATPRG-v1.2-Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
Updated
•
209
•
1
jhangmez/CHATPRG-v1.2-Phi-3.5-mini-instruct-GGUF
Text2Text Generation
•
Updated
•
511
•
1
legraphista/xLAM-8x7b-r-IMat-GGUF
Text Generation
•
Updated
•
401
•
1
legraphista/DeepSeek-V2.5-IMat-GGUF
Text Generation
•
Updated
•
1
mayaeary/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
42
•
39
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
•
Updated
•
127
•
121
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
•
Updated
•
8
•
2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
•
Updated
•
11
•
2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
8
•
5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
•
Updated
•
9
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
•
Updated
•
8
4bit/pygmalion-6b-4bit-128g
Text Generation
•
Updated
•
9
•
3
mlabonne/gpt2-GPTQ-4bit
Text Generation
•
Updated
•
15
seonglae/opt-125m-4bit-gptq
Text Generation
•
Updated
•
9