Longxu Dou's picture

Longxu Dou PRO

dreamerdeo

·

https://longxudou.github.io/

AI & ML interests

Natural Language Processing

Recent Activity

new activity 3 days ago

sail/Sailor2-20B-Chat:Hi Sail team! a request for data for quantization of your model

updated a model 12 days ago

sail/Sailor-0.5B-Chat-gguf

updated a model 12 days ago

sail/Sailor-1.8B-Chat-gguf

View all activity

Organizations

dreamerdeo's activity

upvoted 4 collections 25 days ago

Sailor2 Benchmarks

1 item • Updated 30 days ago • 2

Sailor2 Post-training Datasets

3 items • Updated 30 days ago • 5

Sailor2 Pre-training Datasets

8 items • Updated 29 days ago • 4

Sailor2 Models

6 items • Updated 29 days ago • 4

upvoted a collection about 1 month ago

🔱 Sailor2 Language Models

Sailing in South-East Asia with Inclusive Multilingual LLMs • 9 items • Updated 30 days ago • 22

upvoted 2 collections about 2 months ago

OpenCoder Model

OpenCoder Models • 9 items • Updated Nov 19, 2024 • 9

OS-Atlas

OS-Atlas series models • 7 items • Updated Nov 18, 2024 • 12

upvoted an article 6 months ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By

•

Jul 11, 2024

• 10

upvoted a collection 6 months ago

📈 Scaling Laws with Vocabulary

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11, 2024 • 6

upvoted 2 papers 6 months ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18, 2024 • 53

Bootstrapping Language Models with DPO Implicit Rewards

Paper • 2406.09760 • Published Jun 14, 2024 • 38

upvoted 2 collections 6 months ago

💡 DICE

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28, 2024 • 9

🧬 RegMix: Data Mixture as Regression

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26, 2024 • 8

upvoted a paper 6 months ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published Jul 1, 2024 • 35

upvoted 2 collections 8 months ago

Datasets for Pretrained Thai LLM

List Datasets for pretrained Thai LLM by PyThaiNLP • 23 items • Updated Sep 12, 2024 • 9

Text dataset

Gather text dataset. • 23 items • Updated 16 days ago • 1

upvoted an article 8 months ago

Article

Large-scale Near-deduplication Behind BigCode

May 16, 2023

• 19

upvoted a collection 9 months ago

Meta Llama 3

This collection hosts the transformers and original repos of the Meta Llama 3 and Llama Guard 2 releases • 5 items • Updated 27 days ago • 698

upvoted a paper 9 months ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4, 2024 • 20

upvoted a collection 10 months ago

Awesome SFT datasets

A curated list of interesting datasets to fine-tune language models with. • 43 items • Updated Apr 12, 2024 • 124