Awesome SFT datasets - a HuggingFaceH4 Collection

HuggingFaceH4 's Collections

Zephyr 7B Gemma

Papers We've Read

Awesome SFT datasets

Awesome feedback datasets

Awesome reward models

Awesome SFT datasets

updated Apr 12

A curated list of interesting datasets to fine-tune language models with.

bjoernp/ultrachat_de

Viewer • Updated Dec 2, 2023 • 959 • 56 • 7
openchat/openchat_sharegpt4_dataset

Updated Jul 1, 2023 • 264 • 166

Note One of the datasets behind OpenChat-3.5
imone/OpenOrca_FLAN

Viewer • Updated Dec 8, 2023 • 1.58M • 156 • 15

Note One of the datasets behind OpenChat-3.5
tiedong/goat

Viewer • Updated May 25, 2023 • 1.75M • 74 • 34

Note One of the datasets behind OpenChat-3.5, focused on arithmetic
LDJnr/LessWrong-Amplify-Instruct

Viewer • Updated Jun 3 • 663 • 62 • 44

Note One of the datasets behind OpenChat-3.5
LDJnr/Pure-Dove

Viewer • Updated Jun 3 • 3.86k • 88 • 73

Note One of the datasets behind OpenChat-3.5. Possible leakage with MT-Bench prompts
glaiveai/glaive-code-assistant

Viewer • Updated Sep 27, 2023 • 136k • 120 • 87
meta-math/MetaMathQA

Viewer • Updated Dec 21, 2023 • 395k • 5.85k • 327
OpenAssistant/oasst_top1_2023-08-25

Viewer • Updated Aug 28, 2023 • 13.6k • 201 • 61

Note One of the datasets behind OpenChat-3.5
TIGER-Lab/MathInstruct

Viewer • Updated May 15 • 262k • 1.98k • 248
ise-uiuc/Magicoder-Evol-Instruct-110K

Viewer • Updated Dec 28, 2023 • 111k • 776 • 149
ise-uiuc/Magicoder-OSS-Instruct-75K

Viewer • Updated Dec 4, 2023 • 75.2k • 974 • 140
GAIR/lima

Viewer • Updated Jun 8, 2023 • 1.33k • 1.59k • 411
allenai/tulu-v2-sft-mixture

Viewer • Updated May 24 • 326k • 1.56k • 117

Note Some subsets are NC
glaiveai/glaive-function-calling-v2

Viewer • Updated Sep 27, 2023 • 113k • 426 • 392
glaiveai/glaive-code-assistant-v2

Viewer • Updated Apr 4 • 215k • 72 • 43
openai/gsm8k

Viewer • Updated Jan 4 • 17.6k • 203k • 418
jondurbin/airoboros-3.1

Viewer • Updated Dec 26, 2023 • 59.3k • 67 • 55
teknium/OpenHermes-2.5

Viewer • Updated Apr 15 • 1M • 6.32k • 682
Open-Orca/SlimOrca

Viewer • Updated Oct 12, 2023 • 518k • 629 • 270
lmsys/lmsys-chat-1m

Viewer • Updated Jul 27 • 1M • 44.2k • 599
garage-bAInd/Open-Platypus

Viewer • Updated Jan 24 • 24.9k • 2.44k • 370
LDJnr/Puffin

Viewer • Updated Jun 7 • 3k • 209 • 91
nampdn-ai/tiny-codes

Viewer • Updated Sep 30, 2023 • 1.63M • 253 • 230
shahules786/orca-chat

Viewer • Updated Jul 25, 2023 • 198k • 157 • 110
lmsys/chatbot_arena_conversations

Viewer • Updated Sep 30, 2023 • 33k • 521 • 340
cognitivecomputations/dolphin

Viewer • Updated Dec 18, 2023 • 3.73M • 470 • 399
pankajmathur/WizardLM_Orca

Viewer • Updated Jun 26, 2023 • 55k • 48 • 70
nomic-ai/gpt4all-j-prompt-generations

Viewer • Updated Apr 24, 2023 • 809k • 194 • 215
codeparrot/apps

Viewer • Updated Oct 20, 2022 • 20k • 2.72k • 124
allenai/WildChat

Viewer • Updated Oct 17 • 529k • 1.41k • 121
allenai/WildChat-nontoxic

Viewer • Updated May 6 • 530k • 160 • 23
LDJnr/Capybara

Viewer • Updated Jun 7 • 16k • 419 • 226
OpenAssistant/oasst2

Viewer • Updated Jan 11 • 135k • 1.35k • 215

Note The final version of the OpenAssistant dataset, consisting of 130k messages.
SebastianBodza/LeetCode_UserSubmissions

Viewer • Updated Jan 3 • 138k • 7 • 10
nuprl/CanItEdit

Viewer • Updated Mar 19 • 105 • 252 • 11
totally-not-an-llm/EverythingLM-data-V3

Viewer • Updated Sep 11, 2023 • 1.07k • 72 • 31
OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset

Paper • 2402.10176 • Published Feb 15 • 35
microsoft/orca-math-word-problems-200k

Viewer • Updated Mar 4 • 200k • 1.78k • 415
qintongli/GSM-Plus-v0

Viewer • Updated Mar 4 • 10.6k • 53 • 6
Vezora/Tested-143k-Python-Alpaca

Viewer • Updated Mar 23 • 143k • 191 • 32