Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam
Paper
•
2502.17055
•
Published
•
16
Haotian Hu
cspikachu
·
AI & ML interests
Efficient training for LLMs
Recent Activity
authored
a paper
12 days ago
Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam
upvoted
a
paper
12 days ago
Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam
upvoted
a
paper
3 months ago
APOLLO: SGD-like Memory, AdamW-level Performance
Organizations
None yet