371
The Ultra-Scale Playbook
🌌
The ultimate guide to training LLM on large GPU Clusters
Omkar Pangarkar
omkarenator
AI & ML interests
None yet
Recent Activity
liked
a Space
about 8 hours ago
nanotron/ultrascale-playbook
new activity
5 days ago
LLM360/TxT360:fix-deps
updated
a Space
5 days ago
LLM360/TxT360
Organizations
omkarenator's activity
liked
a
Space
about 8 hours ago
fix-deps
#7 opened 5 days ago
by
omkarenator
updated
a
Space
5 days ago
code-formatting
#6 opened 7 days ago
by
omkarenator
liked
a
Space
15 days ago
upvoted
an
article
23 days ago
Article
Open-R1: a fully open reproduction of DeepSeek-R1
•
762
Add citations and other fixes
#4 opened 4 months ago
by
omkarenator
liked
a
dataset
4 months ago
Update arxiv examples
3
#3 opened 4 months ago
by
zhoujun
upvoted
an
article
4 months ago
Article
Scaling AI-based Data Processing with Hugging Face + Dask
•
28
updated
a
Space
5 months ago
updated
a
Space
6 months ago
liked
a
Space
6 months ago
upvoted
a
paper
6 months ago
liked
a
dataset
6 months ago
liked
a
dataset
8 months ago
upvoted
4
papers
about 1 year ago
Neural Circuit Diagrams: Robust Diagrams for the Communication, Implementation, and Analysis of Deep Learning Architectures
Paper
•
2402.05424
•
Published
•
16
Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling
Paper
•
2401.16380
•
Published
•
49
Transformers are Multi-State RNNs
Paper
•
2401.06104
•
Published
•
37
The Stack: 3 TB of permissively licensed source code
Paper
•
2211.15533
•
Published
•
5