Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

15,161

Full-text search

Active filters: 4-bit

nihal-mp/gemma_lora

Text Generation • Updated Jul 5 • 3

elysiantech/gemma-2b-awq-4bit

Text Generation • Updated Jul 5 • 12

elysiantech/phi-3-mini-4k-instruct-awq-4bit

Text Generation • Updated Jul 6 • 3

lalafenno/falcon-7b-i-QLoRa-HL_qa

Text Generation • Updated Jul 5 • 2

lalafenno/Falcon-7b-i-QLoRa-HL_med

Text Generation • Updated Jul 6 • 4

alibayram/DoktorGemma2-9b-adapter

Text Generation • Updated Jul 6 • 1

openerotica/c4ai-command-r-plus-GPTQ-ERQ

Text Generation • Updated Jul 14 • 27

wesley7137/adonis-uncsensored-nsfw-8b-4bit

Text Generation • Updated Jul 6 • 1

PrunaAI/openbmb-MiniCPM-S-1B-sft-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 13

Weni/ZeroShot-Agents-Llama3-4.0.52-SFT-AWQ

Text Generation • Updated Jul 6 • 3

Sharan1712/llama2_7B_unnaturalcore_qrslora_4bit_2d

Text Generation • Updated Jul 6 • 2

Sharan1712/llama2_7B_unnaturalcore_qdora_4bit_5c

Text Generation • Updated Jul 6 • 3

blockblockblock/calm3-22b-chat-bpw4-exl2

Text Generation • Updated Jul 6 • 12

sangthree/hospital_fintuning_1

Ebullioscopic/phi_3_math_full_fine_tuned

Text Generation • Updated Jul 6 • 5

4darsh-Dev/Meta-Llama-3-8B-quantized-GPTQ

Text Generation • Updated Jul 6 • 1

ModelCloud/DeepSeek-V2-Lite-gptq-4bit

Text Generation • Updated Jul 9 • 55

DariaaaS/test_point

Text Generation • Updated Jul 6 • 4

Weni/ZeroShot-Agents-Llama3-4.0.53-SFT-AWQ

Text Generation • Updated Jul 6 • 2

sims2k/Saul-Instruct-v1-gdpr-finetuned-v4.1

Text Generation • Updated 23 days ago • 7

Weni/ZeroShot-Agents-Llama3-4.0.54-SFT-AWQ

Text Generation • Updated Jul 6 • 3

AryanNsc/Mistral-7b-4bit

Text Generation • Updated Jul 6 • 2

Shaleen123/gemma2-9b-law

Text Generation • Updated Jul 6 • 2 • 1

Fischerboot/adapter-goofy

Weni/ZeroShot-Agents-Llama3-4.0.55-SFT-AWQ

Text Generation • Updated Jul 7 • 4

chohtet/llama3_8b_instruct_4bit_45706_ft3

Text Generation • Updated Jul 7 • 5

pankajmathur/orca_mini_v7_7b-AWQ

Text Generation • Updated Jul 7 • 5 • 1

pankajmathur/orca_mini_v6_8b-AWQ

Text2Text Generation • Updated Jul 7 • 2 • 1

pankajmathur/orca_mini_v6_8b_dpo-AWQ

Text2Text Generation • Updated Jul 7 • 7 • 1

wesley7137/adonis-uncsensored-nsfw-4bit-qlora-merged-final

Text Generation • Updated Jul 7 • 14