Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

4,664

Full-text search

Active filters: dpo

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-logic-dpo

Text Generation • Updated Sep 2, 2024 • 148

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-dpo

Text Generation • Updated Sep 2, 2024 • 148

NicholasCorrado/uf-rlced-conifer_tulu-2-7b-group-dpo-no-clip

Text Generation • Updated Sep 2, 2024 • 6

mradermacher/uf-tulu-2-7b-dpo-GGUF

Updated Sep 2, 2024

mradermacher/zephyr-7b-hh-dpo-GGUF

Updated Sep 3, 2024 • 85

sfulay/zephyr-7b-dpo-full-gpt-reward-scale-05

Updated Sep 3, 2024 • 6

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2

Updated Sep 3, 2024 • 3

mradermacher/uf-tulu-2-7b-dpo-i1-GGUF

Updated Sep 2, 2024 • 85

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-05

Updated Sep 3, 2024 • 4

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-05

Updated Sep 3, 2024 • 7

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-group-dpo

Text Generation • Updated Sep 3, 2024 • 11

mradermacher/zephyr-7b-hh-dpo-i1-GGUF

Updated Sep 3, 2024 • 121

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-dpo-2

Text Generation • Updated Sep 3, 2024 • 8

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-coding-dpo-2

Text Generation • Updated Sep 3, 2024 • 13

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-math-coding-dpo-2

Text Generation • Updated Sep 3, 2024 • 7

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-logic-dpo-2

Text Generation • Updated Sep 3, 2024 • 94

NicholasCorrado/tinyllama-1.1b-chat-v1.0-ui-dpo-2

Text Generation • Updated Sep 3, 2024 • 90

tsavage68/Na_L3_1000steps_1e6rate_03beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 6

NicholasCorrado/tinyllama-1.1b-chat-v1.0-rlced-conifer-3-1-dpo

Text Generation • Updated Sep 4, 2024 • 93

NicholasCorrado/tulu-2-7b-rlced-conifer-dpo

Text Generation • Updated Sep 4, 2024 • 6

tsavage68/Na_L3_1000steps_1e6rate_01beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 8

NanQiangHF/llama3.1_8b_dpo_bwgenerator

Updated Sep 18, 2024 • 5

CultriX/Lama-DPOlphin-8B

Text Generation • Updated Sep 4, 2024 • 12 • 1

tsavage68/Na_L3_150steps_1e6rate_01beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 5

tsavage68/Na_L3_100steps_1e6rate_03beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 5

NicholasCorrado/zephyr-7b-uf-rlced-conifer-dpo-2e

Text Generation • Updated Sep 6, 2024 • 10

tsavage68/Na_L3_1000steps_1e6rate_05beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 6

tsavage68/Na_L3_100steps_1e6rate_05beta_cSFTDPO

Text Generation • Updated Sep 4, 2024 • 5

CultriX/Lama-DPOlphin-8B-Q3_K_S-GGUF

Text Generation • Updated Sep 4, 2024 • 5 • 1

CultriX/Lama-DPOlphin-8B-Q3_K_M-GGUF

Text Generation • Updated Sep 4, 2024 • 10 • 1