Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,112

Full-text search

Active filters: 4-bit

TheBloke/airoboros-13B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 29 • 34

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 48 • 130

TheBloke/LLaMa-7B-GPTQ

Text Generation • Updated Sep 20, 2023 • 365 • 4

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 34.4k • 255

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 22.7k • 358

TheBloke/MythoLogic-Mini-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 15 • 13

TheBloke/CodeUp-Llama-2-13B-Chat-HF-GPTQ

Text Generation • Updated Sep 27, 2023 • 32 • 16

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.68k • 166

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 90 • 8

TheBloke/Phind-CodeLlama-34B-v2-GPTQ

Text Generation • Updated Sep 27, 2023 • 222 • 87

baichuan-inc/Baichuan2-7B-Chat-4bits

Text Generation • Updated Dec 24, 2023 • 543 • 56

baichuan-inc/Baichuan2-13B-Chat-4bits

Text Generation • Updated Jan 8 • 664 • 86

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 29k • 78

TheBloke/Pygmalion-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 58 • 42

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 417 • 12

TheBloke/Llama-2-13B-chat-AWQ

Text Generation • Updated Nov 9, 2023 • 9.2k • 25

TheBloke/vicuna-7B-v1.5-AWQ

Text Generation • Updated Nov 9, 2023 • 86 • 4

TheBloke/Llama-2-13B-German-Assistant-v4-AWQ

Text Generation • Updated Nov 9, 2023 • 8 • 2

TheBloke/upstage-llama-30b-instruct-2048-AWQ

Text Generation • Updated Nov 9, 2023 • 11 • 2

TheBloke/PuddleJumper-13B-V2-GPTQ

Text Generation • Updated Sep 27, 2023 • 8 • 2

TheBloke/storytime-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 407 • 20

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 594 • 103

TheBloke/CodeFuse-13B-GPTQ

Text Generation • Updated Oct 4, 2023 • 6 • 4

TheBloke/Llama-2-7B-vietnamese-20k-AWQ

Text Generation • Updated Nov 9, 2023 • 19 • 5

TheBloke/Xwin-LM-13B-v0.2-AWQ

Text Generation • Updated Nov 9, 2023 • 16 • 4

TheBloke/Euryale-1.3-L2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 11 • 5

TheBloke/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • Updated Oct 22, 2023 • 88.8k • 32

TheBloke/zephyr-7B-beta-AWQ

Text Generation • Updated Nov 9, 2023 • 52.4k • 38

squarelike/Gugugo-koen-7B-V1.1-GPTQ

Translation • Updated Nov 19, 2023 • 92 • 2

TheBloke/SciPhi-Mistral-7B-32k-GPTQ

Text Generation • Updated Oct 30, 2023 • 7 • 4