-
-
-
-
-
-
Inference status
Active filters:
gptq
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
•
Updated
•
157k
•
14
Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
2.24k
•
8
TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
308
•
138
TheBloke/Llama-2-13B-chat-GPTQ
Text Generation
•
Updated
•
14.6k
•
360
TechxGenus/Meta-Llama-3-8B-GPTQ
Text Generation
•
Updated
•
757
•
5
Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4
Image-Text-to-Text
•
Updated
•
6.39k
•
4
Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4
Text Generation
•
Updated
•
4.24k
•
13
TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ
Text Generation
•
Updated
•
7.25k
•
315
TheBloke/gorilla-7B-GPTQ
Text Generation
•
Updated
•
18
•
26
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
•
Updated
•
565
•
560
TheBloke/WizardLM-33B-V1-0-Uncensored-SuperHOT-8K-GPTQ
Text Generation
•
Updated
•
49
•
91
TheBloke/Llama-2-7B-Chat-GPTQ
Text Generation
•
Updated
•
62.8k
•
259
TheBloke/airoboros-l2-13b-gpt4-m2.0-GPTQ
Text Generation
•
Updated
•
26
•
29
TheBloke/CodeLlama-13B-Instruct-GPTQ
Text Generation
•
Updated
•
518
•
38
Qwen/Qwen-VL-Chat-Int4
Text Generation
•
Updated
•
5.02k
•
88
TheBloke/Chronos-70B-v2-GPTQ
Text Generation
•
Updated
•
18
•
11
TheBloke/Falcon-180B-Chat-GPTQ
Text Generation
•
Updated
•
133
•
69
TheBloke/storytime-13B-GPTQ
Text Generation
•
Updated
•
486
•
27
TheBloke/Mistral-7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
•
293k
•
76
TheBloke/llava-v1.5-13B-GPTQ
Text Generation
•
Updated
•
132
•
35
TheBloke/zephyr-7B-beta-GPTQ
Text Generation
•
Updated
•
13.8k
•
55
01-ai/Yi-6B-Chat-8bits
Text Generation
•
Updated
•
207
•
9
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
•
Updated
•
109k
•
130
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
•
Updated
•
35.1k
•
49
TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ
Text Generation
•
Updated
•
130
•
97
TheBloke/DaringMaid-20B-GPTQ
Text Generation
•
Updated
•
29
•
5
TheBloke/openchat-3.5-0106-GPTQ
Text Generation
•
Updated
•
172
•
7
TheBloke/phi-2-electrical-engineering-GPTQ
Text Generation
•
Updated
•
25
•
7
Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4
Text Generation
•
Updated
•
118
•
12
neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
Updated
•
134k
•
11