When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
Paper
•
2411.13476
•
Published
•
16
Seongjin Lee
GirinMan
AI & ML interests
NLP, LLM, Langchain
Recent Activity
liked
a dataset
10 days ago
albertvillanova/legal_contracts
liked
a dataset
10 days ago
THUDM/LongReward-10k
liked
a dataset
11 days ago
CarrotAI/Korean-Common
Organizations
