1 5 3

Songlin Yang

sonta7

https://sustcsonglin.github.io/

AI & ML interests

None yet

Recent Activity

liked a dataset about 1 month ago

HuggingFaceFW/fineweb-edu

liked a dataset about 1 month ago

HuggingFaceFW/fineweb-edu-score-2

upvoted an article about 1 month ago

History of State Space Models (SSM) in 2022

View all activity

Organizations

sonta7's activity

liked 2 datasets about 1 month ago

HuggingFaceFW/fineweb-edu

Viewer • Updated Oct 11 • 3B • 627k • 546

HuggingFaceFW/fineweb-edu-score-2

Viewer • Updated Jun 2 • 11.8B • 31.3k • 62

upvoted an article about 1 month ago

Article

History of State Space Models (SSM) in 2022

•

Apr 11

• 14

updated a model about 2 months ago

fla-hub/mamba-2.7B-100B

Text Generation • Updated Oct 1 • 31 • 2

upvoted a paper 2 months ago

A Controlled Study on Long Context Extension and Generalization in LLMs

Paper • 2409.12181 • Published Sep 18 • 43

authored 3 papers 2 months ago

upvoted a paper 2 months ago

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11 • 19

commented a paper 2 months ago

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11 • 19 •

updated a collection 2 months ago

GSA

Collection

3 items • Updated 14 days ago • 2

upvoted a paper 6 months ago

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10 • 3

upvoted a collection 7 months ago

based

Collection

These language model checkpoints are trained at the 360M and 1.3Bn parameter scales for up to 50Bn tokens on the Pile corpus, for research purposes. • 15 items • Updated Oct 18 • 9

authored a paper 7 months ago

HGRN2: Gated Linear RNNs with State Expansion

Paper • 2404.07904 • Published Apr 11 • 17

liked a dataset 7 months ago

HuggingFaceTB/cosmopedia

Viewer • Updated Aug 12 • 31.1M • 5.49k • 566