Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,115

Full-text search

Active filters: 4-bit

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 537k • 48

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 472k • 103

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 2.1k • 13

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated 15 days ago • 5k • 17

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated 6 days ago • 910 • 4

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated 6 days ago • 368 • 4

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 227 • 92

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 2.57k • 210

TechxGenus/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.36k • 10

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 1.05k • 11

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 23 days ago • 66.3k • 21

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated 27 days ago • 745 • 6

rainjay/gemma-2-27b-it-4bit

Text Generation • Updated 5 days ago • 40 • 3

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 8k • 20

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated May 25 • 505k • 138

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 9.8k • 34

UDA-LIDI/4-BITS-NF4-Reglamento-estudiantes-Universidad-del-Azuay

Text Generation • Updated 28 days ago • 126 • 2

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated 27 days ago • 149k • 16

LoneStriker/Higgs-Llama-3-70B-4.0bpw-h6-exl2

Text Generation • Updated 27 days ago • 8 • 2

AlyBendo/DPO-DoubleQuant-MCQA-TrueMixin

Text2Text Generation • Updated 22 days ago • 13 • 2

IlyaGusev/saiga_aya_23_35b_sft_m1_d5_awq_4bit

Text Generation • Updated 11 days ago • 23 • 2

minyichen/Llama-3-Taiwan-70B-Instruct-GPTQ

Text Generation • Updated about 23 hours ago • 2

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 1.77k • 186

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.72k • 309

TheBloke/Manticore-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 14 • 37

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 495 • 548

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 59 • 82

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 113 • 176

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 97 • 17

TheBloke/baichuan-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 22 • 14