Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

12,148

Full-text search

Active filters: 4-bit

markim/drug-profile-llama-3-awq

Text Generation • Updated 25 days ago • 15

Xu-Ouyang/pythia-2.8b-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated 24 days ago • 11

VincentChoi00/STOCK_SOLAR-10.7B-AWQ

Text Generation • Updated 22 days ago • 152

Xu-Ouyang/pythia-6.9b-deduped-int4-step36000-GPTQ-wikitext2

Text Generation • Updated 24 days ago • 10

Dudep/Meta-Llama-3-8B-sft

Text Generation • Updated 24 days ago • 9

elysiantech/llama-3-8b-gptq-4bit

Text Generation • Updated 24 days ago • 29

Xu-Ouyang/pythia-6.9b-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated 24 days ago • 15

Sayalik45/llama-3-8b-instruct-laws

Updated 24 days ago • 8

Granther/Phi3-128k-Instruct-4Bit-GPTQ

Text Generation • Updated 21 days ago • 37

agahebr/magnum-gptq

Text Generation • Updated 23 days ago • 7

ahmetsalihK/test_axolotl

Updated 24 days ago • 4

cc8055/4bitfinetunnedtinyllamagroq-AWQ

Text Generation • Updated 24 days ago • 8

Lkynnn/Quantized_opt-125m

Text Generation • Updated 24 days ago • 42

PeterGordon/test1

Text Generation • Updated 24 days ago • 1

PrunaAI/zjunlp-OceanGPT-7b-v0.1-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 7

rainjay/gemma-2-9b-it-4bit

Text Generation • Updated 24 days ago • 66

leliuga/gemma-2-9b-bnb-4bit

Text Generation • Updated 24 days ago • 15

thesven/Aether-Code-Mistral-7B-0.3-v1-bnb-4bit

Text Generation • Updated 24 days ago • 68

leliuga/gemma-2-9b-it-bnb-4bit

Text Generation • Updated 24 days ago • 16

Weni/ZeroShot-Agents-Llama3-4.0.41-DPO-AWQ

Text Generation • Updated 24 days ago • 11

macadeliccc/Samantha-Qwen2-1.5B-QLoRa

Text Generation • Updated 24 days ago • 2

kheopss/kheops_fr_en_epoch1_4bit_v4

Text Generation • Updated 24 days ago • 47

Source82/axolotl-llama-osa-qlora

Text Generation • Updated 24 days ago • 7

amanpatkar/tiny-random-llama-2

Text Generation • Updated 24 days ago • 67

PrunaAI/victunes-TherapyLlama-8B-v1-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 3

PrunaAI/victunes-TherapyLlama-8B-v1-AWQ-4bit-smashed

Text Generation • Updated 10 days ago • 3

johnpaulbin/llama8b-tokipona-epoch1-merged

Text Generation • Updated 24 days ago • 23

gisang-lee/mistral-7b-qlora-alpaca-sample-0.5k

Text Generation • Updated 24 days ago • 15

sims2k/Saul-Instruct-v1-gdpr-finetuned-v1.1

Text Generation • Updated 12 days ago • 36

PrunaAI/RuterNorway-Llama-2-13b-chat-norwegian-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1