Efficient LLM Pretraining: Packed Sequences and Masked Attention
•
7
Lukas
sirluk
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
28 days ago
A Large Recurrent Action Model: xLSTM enables Fast Inference for
Robotics Tasks
authored
a paper
about 2 months ago
One Initialization to Rule them All: Fine-tuning via Explained Variance
Adaptation
upvoted
a
paper
about 2 months ago
Retrieval-Augmented Decision Transformer: External Memory for In-context
RL
Articles
Organizations
sirluk's activity
liked
a
dataset
5 months ago