Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

3,911

Full-text search

Active filters: 8-bit

Xu-Ouyang/pythia-410m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 10

Xu-Ouyang/pythia-410m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 8

Xu-Ouyang/pythia-410m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 8

Xu-Ouyang/pythia-410m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 9

Xu-Ouyang/pythia-6.9b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 9

Xu-Ouyang/pythia-6.9b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 6

Xu-Ouyang/pythia-6.9b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated 20 days ago • 10

Adeptschneider/dyu_to_fr_v8.0_flan-t5-8bit

Text2Text Generation • Updated Jul 12 • 18

Xu-Ouyang/pythia-6.9b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated 20 days ago • 8

Xu-Ouyang/pythia-6.9b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated 20 days ago • 8

nhotin/vistral7B-legalbizai-q8-gguf

Text Generation • Updated Jul 12 • 4

XelotX/WizardLM-2-8x22B-XelotX-iQuants

Text Generation • Updated Jul 12 • 13

Xu-Ouyang/pythia-160m-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 9

Xu-Ouyang/pythia-160m-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 8

Xu-Ouyang/pythia-160m-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 8

Xu-Ouyang/pythia-160m-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 8

Xu-Ouyang/pythia-160m-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated 21 days ago • 7

Xu-Ouyang/pythia-1b-deduped-int8-step36000-GPTQ-wikitext2

Text Generation • Updated 16 days ago • 6

Xu-Ouyang/pythia-1b-deduped-int8-step71000-GPTQ-wikitext2

Text Generation • Updated 16 days ago • 9

Xu-Ouyang/pythia-1b-deduped-int8-step107000-GPTQ-wikitext2

Text Generation • Updated 16 days ago • 6

Xu-Ouyang/pythia-1b-deduped-int8-step110000-GPTQ-wikitext2

Text Generation • Updated 16 days ago • 5

Xu-Ouyang/pythia-1b-deduped-int8-step143000-GPTQ-wikitext2

Text Generation • Updated 16 days ago • 7

PrunaAI/hon9kon9ize-CantoneseLLMChat-preview20240326-bnb-8bit-smashed

Text Generation • Updated Jul 13 • 5

amphora/l3kpm-lima

Updated Jul 14 • 2

amphora/l3kpm-lima-96

Updated Jul 14 • 2

PrunaAI/openlynn-Llama-3-Soliloquy-8B-v2-bnb-8bit-smashed

Text Generation • Updated Jul 14 • 5

bullerwins/Big-Tiger-Gemma-27B-v1-exl2_8.0bpw

Text Generation • Updated Jul 14 • 32 • 1

smokxy/agri_bert_classifier_quantized

Text Classification • Updated Jul 14 • 5

PrunaAI/SeaLLMs-SeaLLM-7B-v2.5-bnb-8bit-smashed

Text Generation • Updated Jul 14 • 5

smokxy/roberta-base-squad2-quantized

Question Answering • Updated Aug 5 • 15