Edit Models filters

trl-lib/ultrafeedback_binarized

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

HuggingFaceH4/ultrafeedback_binarized

teknium/OpenHermes-2.5

HuggingFaceH4/ultrachat_200k

cis-lmu/Glot500

fka/awesome-chatgpt-prompts

Open-Orca/OpenOrca

allenai/MADLAD-400

microsoft/orca-math-word-problems-200k

oscar-corpus/OSCAR-2109

bigcode/starcoderdata

Intel/orca_dpo_pairs

Open-Orca/SlimOrca

cerebras/SlimPajama-627B

m-a-p/CodeFeedback-Filtered-Instruction

garage-bAInd/Open-Platypus

TIGER-Lab/MathInstruct

meta-math/MetaMathQA

jondurbin/gutenberg-dpo-v0.1

legacy-datasets/wikipedia

cognitivecomputations/dolphin-coder

databricks/databricks-dolly-15k

mozilla-foundation/common_voice_13_0

OpenAssistant/oasst1

jondurbin/airoboros-2.2.1

cognitivecomputations/samantha-data

tiiuae/falcon-refinedweb

allenai/ultrafeedback_binarized_cleaned

jondurbin/airoboros-3.2

lmsys/lmsys-chat-1m

facebook/voxpopuli

jondurbin/truthy-dpo-v0.1

teknium/openhermes

migtissera/Synthia-v1.3

EleutherAI/pile

cognitivecomputations/Dolphin-2.9

ise-uiuc/Magicoder-Evol-Instruct-110K

togethercomputer/RedPajama-Data-1T

anthracite-org/kalo-opus-instruct-22k-no-refusal

internlm/Agent-FLAN

Locutusque/function-calling-chatml

Vezora/Tested-22k-Python-Alpaca

mozilla-foundation/common_voice_17_0

nvidia/HelpSteer

nothingiisreal/Reddit-Dirty-And-WritingPrompts

jondurbin/cinematika-v0.1

yahma/alpaca-cleaned

Anthropic/hh-rlhf

HuggingFaceFW/fineweb

Gryphe/Sonnet3.5-Charcard-Roleplay

tatsu-lab/alpaca

glaiveai/glaive-function-calling-v2

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

wikimedia/wikipedia

Muennighoff/natural-instructions

argilla/distilabel-intel-orca-dpo-pairs

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

mozilla-foundation/common_voice_8_0

unalignment/toxic-dpo-v0.2

huggan/smithsonian_butterflies_subset

codeparrot/apps

ise-uiuc/Magicoder-OSS-Instruct-75K

facebook/belebele

camel-ai/biology

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

camel-ai/physics

camel-ai/chemistry

mlabonne/orpo-dpo-mix-40k

HuggingFaceH4/no_robots

grimulkan/LimaRP-augmented

kingbri/PIPPA-shareGPT

OpenAssistant/oasst_top1_2023-08-25

openbmb/UltraFeedback

HuggingFaceFW/fineweb-edu

Nopm/Opus_WritingStruct

anthracite-org/nopm_claude_writing_fixed

m-a-p/Code-Feedback

unalignment/toxic-dpo-v0.1

nvidia/HelpSteer2

HuggingFaceTB/cosmopedia

Models

40

Full-text search

Active filters: trl-lib/ultrafeedback_binarized

hxssgaa/llama-3-8b-dpo-full

Text Generation • Updated Oct 8, 2024 • 19

trl-lib/Qwen2-0.5B-ORPO

Text Generation • Updated Oct 11, 2024 • 18 • 1

qgallouedec/Qwen2.5-7B-DPO-2209

Text Generation • Updated Oct 21, 2024 • 11

qgallouedec/Qwen2.5-7B-DPO-main

Text Generation • Updated Oct 21, 2024 • 11

JayHyeon/Qwen2-0.5B-Reward-ds1

Text Classification • Updated Nov 28, 2024 • 6

JayHyeon/Qwen2-0.5B-Reward_VPO_1e-4

Text Classification • Updated Nov 28, 2024 • 11

JayHyeon/Qwen2-0.5B-Reward_5e-4

Text Classification • Updated Nov 28, 2024 • 9

JayHyeon/Qwen2-0.5B-Reward_VPO_5e-4

Text Classification • Updated Nov 28, 2024 • 10

JayHyeon/Qwen2-0.5B-Reward_1e-3

Text Classification • Updated Nov 28, 2024 • 8

JayHyeon/Qwen2-0.5B-Reward_VPO_1e-3

Text Classification • Updated Nov 28, 2024 • 8

JayHyeon/Qwen2-0.5B-Reward_5e-3

Text Classification • Updated Nov 28, 2024 • 10

JayHyeon/Qwen2-0.5B-Reward_VPO_5e-3

Text Classification • Updated Nov 29, 2024 • 14

skaltenp/Qwen2-1.5B-DPO

Updated Dec 3, 2024

arqa39/Qwen2-0.5B-Reward

Updated 24 days ago

RLHF-And-Friends/Pythia-70M-Reward

Updated 18 days ago

RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward

Updated 10 days ago

RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward-4r

Updated 10 days ago

RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward-8r

Updated 10 days ago

RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward-16r

Updated 10 days ago

RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward-LoRA8r

Updated 10 days ago

RLHF-And-Friends/Llama-3.2-1B-Instruct-Reward-2r

Updated 10 days ago

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-5ep-MDPO_5e-7_3ep_0alp_0lam

Text Generation • Updated 6 days ago • 10

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-5ep-MDPO_7e-7_3ep_0alp_0lam

Text Generation • Updated 5 days ago • 15

JayHyeon/Test-MDPO_5e-7-1ep_0alp_0lam

Text Generation • Updated 4 days ago • 9

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_5e-7-3ep_0alp_0lam

Text Generation • Updated 1 day ago • 43

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_7e-7-3ep_0alp_0lam

Text Generation • Updated 5 days ago • 25

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_1e-6-3ep_0alp_0lam

Text Generation • Updated 5 days ago • 16

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-MDPO_2e-6-3ep_0alp_0lam

Text Generation • Updated 4 days ago • 13

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_1e-6-3ep_0alp_0lam

Text Generation • Updated 4 days ago • 17

JayHyeon/Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_5e-6-3ep_0alp_0lam

Text Generation • Updated 3 days ago • 14