41 13 37

instruction-pretrain

https://huggingface.co/papers/2406.14491

DaixuanC45443

AI & ML interests

Synthetic Instructions for Pre-Training

Recent Activity

updated a model 28 days ago

instruction-pretrain/instruction-synthesizer

upvoted a paper 28 days ago

How to Synthesize Text Data without Model Collapse?

updated a dataset about 2 months ago

instruction-pretrain/general-instruction-augmented-corpora

View all activity

Organizations

None yet

instruction-pretrain's activity

New activity in instruction-pretrain/InstructLM-500M about 2 months ago

Adding `safetensors` variant of this model

#1 opened about 2 months ago by

SFconvertbot

New activity in instruction-pretrain/ft-instruction-synthesizer-collection 3 months ago

Query about the size of dataset

#4 opened 3 months ago by

Applauz

New activity in instruction-pretrain/finance-Llama3-8B 4 months ago

How large is the corpus size used for pretraining the finance LLaMA?

#2 opened 4 months ago by

dhkong

New activity in instruction-pretrain/general-instruction-augmented-corpora 5 months ago

Kept getting stuck in the failed download of part-1/shard/00004.txt from the general-instruction-augmented-corpora

#12 opened 5 months ago by

ben81828

commented 2 papers 5 months ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 87 •

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 87 •

New activity in AdaptLLM/medicine-tasks 5 months ago

Update README.md

#2 opened 5 months ago by

instruction-pretrain

New activity in AdaptLLM/law-tasks 5 months ago

Update README.md

#2 opened 5 months ago by

instruction-pretrain

New activity in AdaptLLM/finance-tasks 5 months ago

Update README.md

#2 opened 5 months ago by

instruction-pretrain

New activity in instruction-pretrain/finance-Llama3-8B 5 months ago

Update README.md

#1 opened 5 months ago by

AdaptLLM

New activity in instruction-pretrain/instruction-synthesizer 5 months ago

Can you share the training code for the instruction synthesizer？

#2 opened 7 months ago by

chenff35

commented 2 papers 6 months ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 87 •

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 87 •

New activity in instruction-pretrain/instruction-synthesizer 6 months ago

Update README.md

#3 opened 6 months ago by

AdaptLLM

New activity in AdaptLLM/law-chat 6 months ago

Update README.md

#2 opened 6 months ago by

instruction-pretrain

New activity in AdaptLLM/finance-chat 6 months ago

Update README.md

#4 opened 6 months ago by

instruction-pretrain

New activity in AdaptLLM/medicine-chat 6 months ago

Update README.md

#5 opened 6 months ago by

instruction-pretrain

New activity in instruction-pretrain/ft-instruction-synthesizer-collection 6 months ago

License

#3 opened 6 months ago by

AmenRa

commented a paper 6 months ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20, 2024 • 87 •

New activity in instruction-pretrain/InstructLM-1.3B 6 months ago

Thanks for the models and data, I have some questions.

#2 opened 7 months ago by

NickyNicky