2 21 76

neuralink

AI & ML interests

None yet

Recent Activity

liked a Space 8 days ago

sail/scaling-with-vocab-demo

liked a Space 8 days ago

lvwerra/harms-law

liked a model 15 days ago

tencent/Tencent-Hunyuan-Large

View all activity

Articles

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14

• 53

Organizations

neuralink's activity

upvoted a paper about 1 month ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 253

upvoted a paper 4 months ago

Small-scale proxies for large-scale Transformer training instabilities

Paper • 2309.14322 • Published Sep 25, 2023 • 19

upvoted an article 4 months ago

Article

How NuminaMath Won the 1st AIMO Progress Prize

Jul 11

• 109

upvoted a paper 4 months ago

Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets

Paper • 2201.02177 • Published Jan 6, 2022 • 2

upvoted an article 4 months ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14

• 53

upvoted a paper 4 months ago

Grokfast: Accelerated Grokking by Amplifying Slow Gradients

Paper • 2405.20233 • Published May 30 • 6

upvoted a paper 5 months ago

Transformer Explainer: Interactive Learning of Text-Generative Models

Paper • 2408.04619 • Published Aug 8 • 155

upvoted 2 papers 6 months ago

What matters when building vision-language models?

Paper • 2405.02246 • Published May 3 • 101

DiPaCo: Distributed Path Composition

Paper • 2403.10616 • Published Mar 15 • 12

upvoted 2 articles 7 months ago

Article

Putting RL back in RLHF

Jun 12

• 65

Article

Let's talk about LLM evaluation

•

May 23

• 140

upvoted 3 papers 9 months ago

upvoted 2 papers 10 months ago

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

Paper • 2402.15627 • Published Feb 23 • 34

FP8-LM: Training FP8 Large Language Models

Paper • 2310.18313 • Published Oct 27, 2023 • 33

upvoted a paper 11 months ago

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 23

upvoted a paper 12 months ago

Unified-IO 2: Scaling Autoregressive Multimodal Models with Vision, Language, Audio, and Action

Paper • 2312.17172 • Published Dec 28, 2023 • 27

upvoted 2 papers about 1 year ago

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents

Paper • 2306.16527 • Published Jun 21, 2023 • 47

RWKV: Reinventing RNNs for the Transformer Era

Paper • 2305.13048 • Published May 22, 2023 • 15