Hugging Face's logo
instruction-pretrain's picture
40 10 35

instruction-pretrain

instruction-pretrain
AhmadHakami's profile picture xxxllill's profile picture VlSav's profile picture
·
https://huggingface.co/papers/2406.14491

AI & ML interests

Synthetic Instructions for Pre-Training

Organizations

None yet

instruction-pretrain's activity

New activity in instruction-pretrain/ft-instruction-synthesizer-collection about 1 month ago

Query about the size of dataset

1
#4 opened about 1 month ago by Applauz
New activity in instruction-pretrain/finance-Llama3-8B about 2 months ago

How large is the corpus size used for pretraining the finance LLaMA?

1
#2 opened about 2 months ago by dhkong
New activity in instruction-pretrain/general-instruction-augmented-corpora 3 months ago

Kept getting stuck in the failed download of part-1/shard/00004.txt from the general-instruction-augmented-corpora

3
#12 opened 3 months ago by ben81828
commented 2 papers 3 months ago
New activity in AdaptLLM/medicine-tasks 3 months ago

Update README.md
#2 opened 3 months ago by instruction-pretrain
New activity in AdaptLLM/law-tasks 3 months ago

Update README.md
#2 opened 3 months ago by instruction-pretrain
New activity in AdaptLLM/finance-tasks 3 months ago

Update README.md
#2 opened 3 months ago by instruction-pretrain
New activity in instruction-pretrain/finance-Llama3-8B 3 months ago

Update README.md
#1 opened 3 months ago by AdaptLLM
New activity in instruction-pretrain/instruction-synthesizer 3 months ago

Can you share the training code for the instruction synthesizer？

5
#2 opened 5 months ago by chenff35
commented 2 papers 4 months ago
New activity in instruction-pretrain/instruction-synthesizer 4 months ago

Update README.md
#3 opened 4 months ago by AdaptLLM
New activity in AdaptLLM/law-chat 4 months ago

Update README.md
#2 opened 4 months ago by instruction-pretrain
New activity in AdaptLLM/finance-chat 4 months ago

Update README.md
#4 opened 4 months ago by instruction-pretrain
New activity in AdaptLLM/medicine-chat 4 months ago

Update README.md
#5 opened 4 months ago by instruction-pretrain
New activity in instruction-pretrain/ft-instruction-synthesizer-collection 4 months ago

License

1
#3 opened 4 months ago by AmenRa
commented a paper 4 months ago
New activity in instruction-pretrain/InstructLM-1.3B 4 months ago

Thanks for the models and data, I have some questions.

5
#2 opened 5 months ago by NickyNicky
New activity in instruction-pretrain/ft-instruction-synthesizer-collection 4 months ago

Can you please also share the synthetic pretraining dataset generated with the synthesizer?

1
#2 opened 5 months ago by yam-peleg