Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Other with no match

text-embeddings-inference

Models

2,568

Full-text search

Active filters: dpo

sosuke/preference_tuning_results

Updated 30 days ago • 1

tsavage68/Summary_L3_150steps_1e7rate_05beta_CSFTDPO

Text Generation • Updated 29 days ago • 4

martimfasantos/tinyllama-1.1b-sum-dpo-full_LR2e-8_3epochs_old

Text Generation • Updated 27 days ago • 15

tsavage68/Summary_L3_1000steps_1e6rate_05beta_CSFTDPO

Text Generation • Updated 29 days ago • 6

tsavage68/Summary_L3_50steps_1e6rate_05beta_CSFTDPO

Text Generation • Updated 29 days ago • 8

yangzhao02/gpt2-large-dpo

Text Generation • Updated 27 days ago • 3

MoxoffSpA/Moxoff-Phi3Mini-DPO

Text Generation • Updated 26 days ago

valerielucro/mistral_gsm8k_sft_and_dpo

Updated 27 days ago

VictorDCh/Llama-3-8B-Instruct-2-spider-3-dpo

Updated 20 days ago • 62

sfulay/zephyr-7b-dpo-full-ultrabin-2

Text Generation • Updated 26 days ago • 7

mradermacher/Llama-3-SauerkrautLM-8b-Instruct-GGUF

Updated 25 days ago • 20.3k

martimfasantos/tinyllama-1.1b-sum-dpo-full_LR5e-8_BS64_2epochs_old

Text Generation • Updated 25 days ago • 14

mradermacher/Llama-3-SauerkrautLM-8b-Instruct-i1-GGUF

Updated 25 days ago • 18.4k

mradermacher/zephyr-7b-dpo-full-ultrabin-2-GGUF

Updated 25 days ago • 10.4k

martimfasantos/tinyllama-1.1b-sum-dpo-full_LR5e-8_BS64_3epochs_old

Text Generation • Updated 24 days ago • 10

mradermacher/Llama-3-8B-Magpie-Pro-MT-UltraDPO-GGUF

Updated 25 days ago • 24.4k

mradermacher/Llama-3-8B-Magpie-Pro-MT-UltraDPO-i1-GGUF

Updated 25 days ago • 13.4k

yangzhao02/llama3-8b-base-dpo

Text Generation • Updated 24 days ago • 6

yangzhao02/gpt2-large-simpo

Text Generation • Updated 24 days ago • 4

mradermacher/Llama-3-8B-Instruct-UltraDPO-GGUF

Updated 24 days ago • 16k

martimfasantos/tinyllama-1.1b-sum-dpo-full_LR5e-8_BS64_4epochs_old

Text Generation • Updated 22 days ago • 7

Yukify/nofinetune-llama3-smp-2-shot-reg-dpo

Text Generation • Updated 23 days ago • 10

mradermacher/Llama-3-8B-Instruct-MagPO-GGUF

Updated 23 days ago • 12.4k

mradermacher/Llama-3-8B-Magpie-Pro-MT-UltraDPO2-GGUF

Updated 13 days ago • 16.8k

valerielucro/mistral_gsm8k_sample_sft_and_dpo_3

Updated 22 days ago

mradermacher/Llama-3-8B-Magpie-Pro-MT-UltraDPO2-NT-GGUF

Updated 13 days ago • 25.8k

Jellywibble/temp_3k_samples

Text Generation • Updated 20 days ago • 2

YYYYYYibo/full_vanilla_dpo_iter_1

Text Generation • Updated 20 days ago • 158

YYYYYYibo/full_vanilla_dpo_iter_2

Text Generation • Updated 20 days ago • 32

YYYYYYibo/full_vanilla_dpo_iter_3

Text Generation • Updated 19 days ago • 2