Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

4,574

Full-text search

Active filters: 8-bit

osiria/prime-6.6b

Text Generation • Updated Jul 6, 2023 • 10

ethzanalytics/open_llama_13b-sharded-8bit

Text Generation • Updated Jul 2, 2023 • 6

vivekraina/bloom-560m-8bit

Text Generation • Updated Jul 4, 2023 • 2

vivekraina/falcon-7b-8bit

Text Generation • Updated Jul 4, 2023 • 3

vivekraina/falcon-7b-Instruct-8bit

Text Generation • Updated Jul 4, 2023 • 8

anejaisha/output2

Text2Text Generation • Updated Jul 5, 2023 • 2

avaassadi/bloom-1b1-alpaca-fine

Text Generation • Updated Jul 6, 2023 • 4

vivekraina/Falcon-instruct-8bit-test

Text Generation • Updated Jul 6, 2023 • 4

Abzu/mpt-7b-q8

Text Generation • Updated Jul 6, 2023 • 7 • 1

Abzu/mpt-7b-instruct-q8

Text Generation • Updated Jul 7, 2023 • 5 • 2

Abzu/mpt-7b-chat-q8

Text Generation • Updated Jul 7, 2023 • 7 • 1

Abzu/mpt-7b-storywriter-q8

Text Generation • Updated Jul 7, 2023 • 8 • 2

Abzu/mpt-30b-q8

Text Generation • Updated Jul 7, 2023 • 7 • 3

Abzu/mpt-30b-chat-q8

Text Generation • Updated Jul 7, 2023 • 11 • 1

Mediocreatmybest/blip2-opt-2.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 60 • 2

Mediocreatmybest/blip2-opt-6.7b_8bit

Image-to-Text • Updated Aug 27, 2023 • 4 • 1

Mediocreatmybest/blip2-flan-t5-xxl_8bit

Visual Question Answering • Updated Jul 9, 2023 • 2

gretelai/falcon-7b

Text Generation • Updated Jul 10, 2023 • 9

sgowdaks/falcon-40b-instruct-8bit

Updated Jul 11, 2023 • 1

FabbriSimo01/GPT_Large_Quantized

Text Generation • Updated Jul 15, 2023 • 957

FabbriSimo01/Bloom_1b_Quantized

Text Generation • Updated Jul 15, 2023 • 930

FabbriSimo01/Facebook_opt_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 934

FabbriSimo01/Cerebras_1.3b_Quantized

Text Generation • Updated Jul 15, 2023 • 908

vivekraina/Falcon-8bit-test

Text Generation • Updated Jul 19, 2023 • 2

trillionmonster/Baichuan-13B-Chat-8bit

Text Generation • Updated Jul 25, 2023 • 5 • 9

vivekraina/Llama-2-7b-hf-8bit

Text Generation • Updated Jul 20, 2023 • 3 • 3

guardrail/llama-2-7b-guanaco-8bit-sharded

Text Generation • Updated Jul 20, 2023 • 14 • 4

richardr1126/spider-skeleton-wizard-coder-8bit

Text Generation • Updated Jul 26, 2023 • 6 • 1

rbiswasfc/falcon-7b-8bit

Text Generation • Updated Jul 21, 2023 • 3

pligor/gr7.5b-dolly

Text Generation • Updated Jul 24, 2023 • 5 • 1