The Impact of Positional Encoding on Length Generalization in Transformers Paper • 2305.19466 • Published May 31, 2023 • 2
Round and Round We Go! What makes Rotary Positional Encodings useful? Paper • 2410.06205 • Published Oct 8, 2024 • 1
ThunderKittens: Simple, Fast, and Adorable AI Kernels Paper • 2410.20399 • Published Oct 27, 2024 • 1
Byte Latent Transformer: Patches Scale Better Than Tokens Paper • 2412.09871 • Published 23 days ago • 80