โ๏ธ Sailor Language Models Collection Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. โข 17 items โข Updated Dec 3, 2024 โข 17
๐ก DICE Collection Self-alignment with DPO Implicit Rewards โข 5 items โข Updated Jul 28, 2024 โข 9
๐ Scaling Laws with Vocabulary Collection Increase your vocabulary size when you scale up your language model โข 5 items โข Updated Aug 11, 2024 โข 6
๐งฌ RegMix: Data Mixture as Regression Collection Automatic data mixture method for large language model pre-training โข 10 items โข Updated Jul 26, 2024 โข 8
๐ฑ Sailor2 Language Models Collection Sailing in South-East Asia with Inclusive Multilingual LLMs โข 9 items โข Updated Dec 3, 2024 โข 22
Balancing Pipeline Parallelism with Vocabulary Parallelism Paper โข 2411.05288 โข Published Nov 8, 2024 โข 19
Balancing Pipeline Parallelism with Vocabulary Parallelism Paper โข 2411.05288 โข Published Nov 8, 2024 โข 19