Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,026

Full-text search

Active filters: 4-bit

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 456k • 101

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 559k • 47

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 177 • 92

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 2.64k • 209

zementalist/llama-3-8B-chat-psychotherapist

Text Generation • Updated Apr 29 • 1.05k • 10

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 21 days ago • 65.7k • 20

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated 4 days ago • 399 • 3

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated 4 days ago • 228 • 3

rainjay/gemma-2-27b-it-4bit

Text Generation • Updated 3 days ago • 29 • 3

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated May 25 • 483k • 137

TechxGenus/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 2.03k • 11

TechxGenus/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Apr 19 • 996 • 9

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated May 22 • 24.6k • 13

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated 25 days ago • 136k • 15

Qwen/Qwen2-57B-A14B-Instruct-GPTQ-Int4

Text Generation • Updated 13 days ago • 4.65k • 15

LoneStriker/Higgs-Llama-3-70B-4.0bpw-h6-exl2

Text Generation • Updated 25 days ago • 8 • 2

AlyBendo/DPO-DoubleQuant-MCQA-TrueMixin

Text2Text Generation • Updated 20 days ago • 12 • 2

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated 11 days ago • 47.3k • 14

IlyaGusev/saiga_aya_23_35b_sft_m1_d5_awq_4bit

Text Generation • Updated 9 days ago • 13 • 2

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 1.69k • 186

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 5.72k • 309

TheBloke/Manticore-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 14 • 37

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 393 • 548

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 58 • 82

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 114 • 176

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 91 • 17

TheBloke/airoboros-13B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 26 • 34

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 49 • 130

TheBloke/LLaMa-7B-GPTQ

Text Generation • Updated Sep 20, 2023 • 298 • 4

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 32.8k • 255