Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Other with no match

Carbon Emissions

Models

6,367

Full-text search

Active filters: bitsandbytes

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 3.16k • 14

nassersala/text-to-color

Updated May 28 • 3 • 1

lllyasviel/omost-dolphin-2.9-llama3-8b-4bits

Text Generation • Updated May 29 • 3.89k • 5

mindchain/quantized-phi-3-mini-4k

Text Generation • Updated Jun 2 • 15 • 1

tarekfer8/llama_djezzy

Text Generation • Updated 26 days ago • 27 • 1

ryorichie/MediChat_Medium

Text Generation • Updated 10 days ago • 8 • 1

unsloth/Qwen2-0.5B-Instruct-bnb-4bit

Text Generation • Updated Jun 6 • 6.6k • 1

unsloth/Qwen2-0.5B-bnb-4bit

Text Generation • Updated Jun 6 • 5.33k • 1

unsloth/Qwen2-7B-bnb-4bit

Text Generation • Updated Jun 6 • 10.9k • 2

unsloth/Qwen2-7B-Instruct-bnb-4bit

Text Generation • Updated Jun 6 • 11.7k • 1

unsloth/Qwen2-72B-bnb-4bit

Text Generation • Updated Jun 6 • 381 • 2

unsloth/Qwen2-1.5B-bnb-4bit

Text Generation • Updated Jun 6 • 4k • 1

nihaal-mansoor/Llama3-mental-health-llm-finetuned-v3-high-accuracy

Text Generation • Updated Jun 7 • 57 • 1

vcadillo/glm-4v-9b-4-bits

Feature Extraction • Updated 22 days ago • 2.5k • 3

zhoukz/qwen2-7b-instruct-4bit

Text Generation • Updated 23 days ago • 17 • 1

PrunaAI/THUDM-cogvlm2-llama3-chinese-chat-19B-int4-HQQ-1bit-smashed

Text Generation • Updated 21 days ago • 2 • 1

rainjay/gemma-2-27b-it-4bit

Text Generation • Updated 10 days ago • 46 • 3

unsloth/Phi-3-mini-4k-instruct-v0-bnb-4bit

Text Generation • Updated 5 days ago • 78 • 1

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated 3 days ago • 481 • 1

Yofuria/Llama-3-8B-sft-qlora

Updated 4 days ago • 3 • 1

Yofuria/Mistral-7B-base-simpo-qlora

Updated 5 days ago • 2 • 1

drunkOnData/Gemma-2-9B-It-SPPO-Iter3-4bit-bnb

Text Generation • Updated 3 days ago • 16 • 1

NiCEtmtm/llama3_torch

Summarization • Updated about 5 hours ago • • 1

Sakuna/LLaMaCoder

Text2Text Generation • Updated Jan 3 • 1 • 1

Mediocreatmybest/instructblip-vicuna-7b_8bit

Image-to-Text • Updated Nov 19, 2023 • 3 • 3

0prodigy/axolotl

Text Generation • Updated Oct 17, 2023 • 3

Mediocreatmybest/instructblip-vicuna-13b_8bit

Text2Text Generation • Updated Nov 19, 2023 • 1

Mediocreatmybest/instructblip-flan-t5-xl_8bit

Image-to-Text • Updated Nov 20, 2023 • 2 • 1

Mediocreatmybest/instructblip-flan-t5-xxl_8bit

Image-to-Text • Updated Nov 20, 2023 • 1 • 1

nominate/llama2-13b-chat-hf-jmc-001-merged-q8_0

Text Generation • Updated Aug 11, 2023 • 2