Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,191

Full-text search

Active filters: 4-bit

solidrust/Confinus-2x7B-AWQ

Text Generation • Updated Apr 17 • 2

mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit

Text Generation • Updated 5 days ago • 934 • 11

solidrust/Solutus-3x7B-AWQ

Text Generation • Updated Apr 18 • 1 • 1

solidrust/Memgpt-3x7b-MOE-AWQ

Text Generation • Updated Apr 18 • 3

abhinand/Meta-Llama-3-8B-GGUF

Text Generation • Updated Apr 18 • 47 • 1

unsloth/llama-3-70b-bnb-4bit

Text Generation • Updated May 5 • 8.31k • 40

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 70.4k • 59

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 5.27k • 17

TechxGenus/Meta-Llama-3-8B-AWQ

Text Generation • Updated Apr 19 • 177 • 2

TechxGenus/Meta-Llama-3-8B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.03k • 3

TechxGenus/Meta-Llama-3-8B-Instruct-GPTQ

Text Generation • Updated Apr 19 • 2.79k • 3

TechxGenus/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Apr 19 • 1.32k • 10

TechxGenus/Meta-Llama-3-70B-AWQ

Text Generation • Updated Apr 19 • 658 • 5

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 9.44k • 23

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 10.3k • 34

SweatyCrayfish/llama-3-8b-quantized

Text Generation • Updated Apr 20 • 5.66k • 2

lucyknada/Aura_Uncensored_l3_8B-AWQ

Text Generation • Updated Apr 21 • 90 • 3

astronomer/Llama-3-8B-GPTQ-4-Bit

Text Generation • Updated Apr 22 • 497 • 6

screevoai/llama3-70b-instruct-4bit

Text Generation • Updated Apr 23 • 1.21k • 1

leliuga/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated 27 days ago • 240 • 2

santoshsto/mistral-4x7b-codegen-MOE-4bit

Text Generation • Updated Apr 24 • 3 • 1

mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-AWQ

Text Generation • Updated Apr 24 • 2.23k • 1

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated 7 days ago • 15.9k • 55

neph1/llama-3-instruct-bellman-8b-swedish

Text Generation • Updated 26 days ago • 456 • 2

TitanML/Llama3-ChatQA-1.5-70B-AWQ-4bit

Text Generation • Updated May 2 • 21 • 4

cortecs/Llama-3-SauerkrautLM-70b-Instruct-GPTQ

Text Generation • Updated May 29 • 103 • 3

solidrust/Llama-3-Refueled-AWQ

Text Generation • Updated May 11 • 10 • 2

vilm/VinaLlama2-14B-GPTQ-Int4

Text Generation • Updated May 15 • 23 • 2

openerotica/Llama-3-lima-nsfw-16k-test-GPTQ

Text Generation • Updated May 17 • 886 • 2

Zoyd/suzume-llama-3-8B-multilingual-4_0bpw-exl2

Text Generation • Updated May 18 • 34 • 2