Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,285

Full-text search

Active filters: 4-bit

Sharan1712/llama2_7B_oasst_qlora_4bit_1e

Text Generation • Updated 10 days ago • 2

Xu-Ouyang/pythia-12b-deduped-int4-step107000-GPTQ-wikitext2

Text Generation • Updated 10 days ago • 14

elysiantech/phi-3-mini-4k-instruct-gptq-4bit

Text Generation • Updated 3 days ago • 45

Xu-Ouyang/pythia-12b-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated 10 days ago • 6

Xu-Ouyang/pythia-12b-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated 8 days ago • 2

DewEfresh/neo-7b-slerp-hermes2

Updated 10 days ago • 18

PrunaAI/Symbol-LLM-Symbol-LLM-13B-Instruct-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

PrunaAI/Symbol-LLM-Symbol-LLM-13B-Instruct-AWQ-4bit-smashed

Text Generation • Updated 10 days ago • 1

PrunaAI/TIGER-Lab-StructLM-7B-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

BigHuggyD/cohereforai_c4ai-command-r-plus_exl2_4.0bpw_h8

Text Generation • Updated 10 days ago • 3

davide221/llm-compiler-7b-ftd-bnb-4bit

Text Generation • Updated 10 days ago • 2

PrunaAI/TheDrummer-Cream-Phi-3-14B-v1-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

PrunaAI/Isotonic-gpt-human-assistant-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

davide221/llm-compiler-13b-ftd-bnb-4bit

Text Generation • Updated 10 days ago • 3

Subh23/Meta-Llama-3-70B-Instruct-4bit

Text Generation • Updated 8 days ago • 25

sims2k/Saul-Instruct-v1-gdpr-finetuned-v2.1

Text Generation • Updated 10 days ago • 7

vaatsav06/p_l3

Text Generation • Updated 10 days ago • 2

PrunaAI/GeneZC-MiniChat-3B-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

Jamphus/my-gemma-2-finetuned-model

Text Generation • Updated 8 days ago • 18

LeonKogler/MergedModel

Text Generation • Updated 9 days ago • 104

Kurkur99/my-awesome-model

Text Generation • Updated 10 days ago • 3

PrunaAI/victunes-TherapyBeagle-11B-v1-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

sims2k/Saul-Instruct-v1-gdpr-finetuned-v3.1

Text Generation • Updated 10 days ago • 6

PrunaAI/victunes-TherapyBeagle-11B-v1-AWQ-4bit-smashed

Text Generation • Updated 10 days ago • 1

acl-srw-2024/llama-3-typhoon-v1.5-8b-instruct-unsloth-sft-epoch-3-gptq-4bit

Text Generation • Updated 10 days ago • 2

PrunaAI/nota-ai-cpt_st-vicuna-v1.3-3.7b-ppl-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

PrunaAI/internlm-AlchemistCoder-DS-6.7B-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1

PrunaAI/internlm-AlchemistCoder-DS-6.7B-AWQ-4bit-smashed

Text Generation • Updated 10 days ago • 1

p11-p11/llama3_4bits_FEN

Text Generation • Updated 10 days ago • 3

PrunaAI/nota-ai-cpt_st-vicuna-v1.3-2.7b-ppl-bnb-4bit-smashed

Text Generation • Updated 10 days ago • 1