Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,149

Full-text search

Active filters: exl2

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_6.0bpw

Text Generation • Updated Jun 22 • 6

FuturisticVibes/dolphin-2.9.2-mixtral-8x22b-4.0bpw-h8-exl2

Text Generation • Updated Jun 22 • 6

SicariusSicariiStuff/jukofyork_Dusk-Miqu-70B_EXL2_6.5bpw

Text Generation • Updated Jun 22 • 6

bullerwins/Llama-3SOME-8B-v2-exl2_6.0bpw

Text Generation • Updated Jun 27 • 57 • 2

bullerwins/Llama-3SOME-8B-v2-exl2_5.0bpw

Text Generation • Updated Jun 27 • 4

bullerwins/Llama-3SOME-8B-v2-exl2_4.0bpw

Text Generation • Updated Jun 27 • 5

bullerwins/Llama-3SOME-8B-v2-exl2_4.5bpw

Text Generation • Updated Jun 27 • 5

bdambrosio/Hermes-2-Theta-Llama-3-70B-8.0bpw-exl2

Text Generation • Updated Jun 22 • 5

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw2.25-exl2

Text Generation • Updated Aug 1 • 4

blockblockblock/TinyLlama-1.1B-Chat-v1.0-bpw2.5-exl2

Text Generation • Updated Jun 22 • 5

blockblockblock/TinyLlama_v1.1-bpw2.25-exl2

Text Generation • Updated Jun 22 • 5

Sinensis/DarkForest-20B-v3.0-bpw3.5-h6-exl2

Text Generation • Updated Jun 22 • 10

Sinensis/DarkForest-20B-v3.0-bpw4.0-h6-exl2

Text Generation • Updated Jun 22 • 7

blockblockblock/TinyLlama_v1.1-bpw2.5-exl2

Text Generation • Updated Jun 22 • 5

blockblockblock/gpt2-bpw6-exl2

Text Generation • Updated Jun 22 • 4

blockblockblock/gpt2-bpw5.5-exl2

Text Generation • Updated Jun 22 • 5

blockblockblock/gpt2-bpw5-exl2

Text Generation • Updated Jun 22 • 6

Sinensis/DarkForest-20B-v3.0-bpw4.5-h6-exl2

Text Generation • Updated Jun 22 • 5

Sinensis/DarkForest-20B-v3.0-bpw5.0-h6-exl2

Text Generation • Updated Jun 22 • 5

Sinensis/DarkForest-20B-v3.0-bpw6.0-h8-exl2

Text Generation • Updated Jun 22 • 5

Sinensis/DarkForest-20B-v3.0-bpw8.0-h8-exl2

Text Generation • Updated Jun 22 • 5

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_5.0bpw

Text Generation • Updated Jun 23 • 5

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_6.0bpw

Text Generation • Updated Jun 23 • 6

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_7.0bpw

Text Generation • Updated Jun 23 • 6

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup_EXL2_8.0bpw

Text Generation • Updated Jun 23 • 5

Pyroserenus/L3-8B-Stheno-v3.3-32K-6.9bpw-h8-exl2

Text Generation • Updated Jun 24 • 5

Pyroserenus/L3-8B-Stheno-v3.3-32K-8.0bpw-h8-exl2

Text Generation • Updated Jun 24 • 39 • 3

grimjim/llama-3-Nephilim-v1-8B-6.5bpw_h6_exl2

Text Generation • Updated 11 days ago • 11

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_3.0bpw

Text Generation • Updated Jun 23 • 5

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_EXL2_3.5bpw

Text Generation • Updated Jun 23 • 5