Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Other with no match

Carbon Emissions

Models

6,310

Full-text search

Active filters: bitsandbytes

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated 5 days ago • 5.14k • 4

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 2.5k • 211

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated 2 days ago • 64.3k • 16

THUDM/cogvlm2-llama3-chinese-chat-19B-int4

Text Generation • Updated May 24 • 13k • 10

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated 2 days ago • 649 • 5

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated 2 days ago • 715 • 3

Doctor-Shotgun/limarpv3-yi-llama-34b-lora

Text Generation • Updated Jan 8 • 3 • 8

Doctor-Shotgun/no-robots-y34b-lora

Text Generation • Updated Nov 12, 2023 • 4 • 5

UDA-LIDI/4-BITS-NF4-Reglamento-estudiantes-Universidad-del-Azuay

Text Generation • Updated about 1 month ago • 126 • 2

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated 30 days ago • 29.9k • 52

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 3.6k • 14

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1 • 112 • 9

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated 29 days ago • 923 • 6

nikravan/glm-4vq

Document Question Answering • Updated 19 days ago • 746 • 3

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated 2 days ago • 3.33k • 5

rainjay/gemma-2-27b-it-4bit

Text Generation • Updated 7 days ago • 42 • 3

Undi95/Mistral-7B-roleplay_alpaca-lora

Text Generation • Updated Sep 28, 2023 • 27 • 7

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 1.34k • 9

Undi95/Leyley-13B-Lora

Text Generation • Updated Nov 26, 2023 • 4 • 4

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Mar 22 • 11.6k • 6

adamo1139/Yi-34B-200K-AEZAKMI-v2-LoRA

Text Generation • Updated May 27 • 1 • 1

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 4 • 1

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 160 • 8

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 222 • 13

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22 • 1.8k • 2

robinsmits/Mistral-Instruct-7B-v0.2-ChatAlpacaV2-4bit

Text Generation • Updated Feb 13 • 964 • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 3.74k • 11

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Apr 18 • 14k • 15

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Apr 18 • 9.46k • 14

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated May 9 • 4.17k • 14