Hugging Face's logo
instruction-pretrain's picture
22 7 16

instruction-pretrain

instruction-pretrain
tomatobobot's profile picture SpyderDy's profile picture hiieu's profile picture
·
https://huggingface.co/papers/2406.14491
DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Organizations

None yet

instruction-pretrain's activity

New activity in instruction-pretrain/instruction-synthesizer 4 days ago

Can you share the training code for the instruction synthesizer？

1
#2 opened 5 days ago by chenff35
New activity in instruction-pretrain/general-instruction-augmented-corpora 5 days ago

[WIP] Upload folder using huggingface_hub (multi-commit c52a6f637864fbe184064fbbeb065b661b62b08c0c6a21af800878b026ae578b)
#5 opened 5 days ago by instruction-pretrain

Upload folder using huggingface_hub

2
#4 opened 6 days ago by instruction-pretrain
New activity in instruction-pretrain/general-instruction-augmented-corpora 6 days ago

Upload folder using huggingface_hub

2
#3 opened 7 days ago by instruction-pretrain
New activity in instruction-pretrain/general-instruction-augmented-corpora 7 days ago

Upload folder using huggingface_hub

2
#2 opened 7 days ago by instruction-pretrain

Upload folder using huggingface_hub

2
#1 opened 7 days ago by instruction-pretrain
New activity in instruction-pretrain/medicine-instruction-augmented-corpora 7 days ago

[WIP] Upload folder using huggingface_hub (multi-commit 8ebb06cb42d4bff0848a06afb875be9366d86662e78fe6a0cb0dfefc461bc7b7)
#5 opened 9 days ago by instruction-pretrain
commented a paper 8 days ago
New activity in instruction-pretrain/medicine-instruction-augmented-corpora 9 days ago

[WIP] Upload folder using huggingface_hub (multi-commit 8ebb06cb42d4bff0848a06afb875be9366d86662e78fe6a0cb0dfefc461bc7b7)
#6 opened 9 days ago by instruction-pretrain

[WIP] Upload folder using huggingface_hub (multi-commit 8ebb06cb42d4bff0848a06afb875be9366d86662e78fe6a0cb0dfefc461bc7b7)
#4 opened 9 days ago by instruction-pretrain

[WIP] Upload folder using huggingface_hub (multi-commit 8ebb06cb42d4bff0848a06afb875be9366d86662e78fe6a0cb0dfefc461bc7b7)
#3 opened 9 days ago by instruction-pretrain

Upload folder using huggingface_hub

2
#2 opened 9 days ago by instruction-pretrain

Upload folder using huggingface_hub

2
#1 opened 9 days ago by instruction-pretrain
New activity in instruction-pretrain/medicine-Llama3-8B 9 days ago

Tokenizer files missing

4
#2 opened 11 days ago by munish0838
New activity in instruction-pretrain/medicine-Llama3-8B 11 days ago

Unable to use model

2
#1 opened 11 days ago by munish0838
New activity in instruction-pretrain/InstructLM-1.3B 11 days ago

cannot use or download model model-00001-of-00002.safetensors

1
#3 opened 11 days ago by Sakura77

can't download the first file of the weights

1
#1 opened 13 days ago by KnutJaegersberg

Thanks for the models and data, I have some questions.

1
#2 opened 12 days ago by NickyNicky
New activity in AdaptLLM/med_knowledge_prob 12 days ago

Update README.md
#1 opened 12 days ago by instruction-pretrain
New activity in instruction-pretrain/instruction-synthesizer 12 days ago

Update README.md
#1 opened 12 days ago by AdaptLLM
New activity in instruction-pretrain/ft-instruction-synthesizer-collection 12 days ago

Can you please also share the synthetic pretraining dataset generated with the synthesizer?

1
#2 opened 12 days ago by yam-peleg
New activity in instruction-pretrain/ft-instruction-synthesizer-collection 13 days ago

[bot] Conversion to Parquet
#1 opened 13 days ago by parquet-converter