Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,111

Full-text search

Active filters: 4-bit

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 2, 2023 • 5.58k • 26

TheBloke/openchat_3.5-16k-AWQ

Text Generation • Updated Nov 11, 2023 • 3.51k • 2

FreedomIntelligence/HuatuoGPT2-34B-4bits

Text Generation • Updated Nov 30, 2023 • 2 • 3

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Mar 22 • 11.6k • 6

Qwen/Qwen-1_8B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 444 • 33

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 19.3k • 41

adamo1139/Yi-34B-200K-AEZAKMI-v2-LoRA

Text Generation • Updated May 27 • 1 • 1

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 14.8k • 12

TheBloke/Mythalion-Kimiko-v2-GPTQ

Text Generation • Updated Dec 14, 2023 • 32 • 4

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 4 • 1

TheBloke/orangetin-OpenHermes-Mixtral-8x7B-GPTQ

Text Generation • Updated Dec 21, 2023 • 450 • 3

TheBloke/Aurora-Nights-70B-v1.0-AWQ

Text Generation • Updated Dec 28, 2023 • 7 • 3

TheBloke/TinyLlama-1.1B-Chat-v1.0-GPTQ

Text Generation • Updated Dec 31, 2023 • 60.9k • 12

TheBloke/dolphin-2.7-mixtral-8x7b-GPTQ

Text Generation • Updated Jan 1 • 329 • 18

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1 • 3.96k • 19

TheBloke/OrcaMaid-v3-13B-32k-AWQ

Text Generation • Updated Jan 10 • 10 • 4

TheBloke/Sensualize-Mixtral-AWQ

Text Generation • Updated Jan 10 • 6 • 5

internlm/internlm2-chat-7b-4bits

Text Generation • Updated Apr 24 • 80 • 3

allennghayoui/code-assistant-AWQ

Text Generation • Updated Jan 15 • 16 • 1

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 65 • 8

MaziyarPanahi/em_german_leo_mistral-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 202 • 2

MaziyarPanahi/sqlcoder-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 242 • 7

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 173 • 1

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • Updated Jan 26 • 30 • 17

MaziyarPanahi/Noromaid-7b-v0.2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 177 • 1

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 170 • 1

TheBloke/CodeLlama-70B-Python-GPTQ

Text Generation • Updated Jan 31 • 53 • 19

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 7.36k • 15

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 1.19k • 46

MaziyarPanahi/CodeLlama-34b-Instruct-hf-GGUF

Text Generation • Updated Feb 1 • 197 • 1