Wenyu Du

wydu's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a collection about 1 month ago

Reasoning

Collection

24 items • Updated Oct 4 • 2

upvoted a collection 2 months ago

🔍 Daily Picks in Interpretability & Analysis of LMs

Collection

Outstanding research in interpretability and evaluation of language models, summarized • 85 items • Updated about 17 hours ago • 91

updated a model 4 months ago

wydu/Samba

Updated Aug 2

upvoted a paper 5 months ago

A Closer Look into Mixture-of-Experts in Large Language Models

Paper • 2406.18219 • Published Jun 26 • 15

authored a paper 5 months ago

Unlocking Continual Learning Abilities in Language Models

Paper • 2406.17245 • Published Jun 25 • 28

commented a paper 5 months ago

Unlocking Continual Learning Abilities in Language Models

Paper • 2406.17245 • Published Jun 25 • 28 •

1

authored a paper 5 months ago

Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training

Paper • 2405.15319 • Published May 24 • 25

upvoted a paper 6 months ago

Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training

Paper • 2405.15319 • Published May 24 • 25

updated 12 models 6 months ago

llm-stacking/StackingLaw_Factor_1.1B12L

Updated Jun 6 • 1

llm-stacking/StackingLaw_Factor_1.1B3L

Updated Jun 6 • 1

llm-stacking/StackingLaw_Factor_1.1B1L

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_1.1B50BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_1.1B20BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_1.1B5BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_1.1B1BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_410M50BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_410M20BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_410M10BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_410M5BT

Updated Jun 6 • 1

llm-stacking/StackingLaw_Timing_410M1BT

Updated Jun 6 • 1