Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models Paper • 2503.09573 • Published 1 day ago • 31
InfiniteHiP: Extending Language Model Context Up to 3 Million Tokens on a Single GPU Paper • 2502.08910 • Published 29 days ago • 143
view article Article Releasing the largest multilingual open pretraining dataset By Pclanglais and 2 others • Nov 13, 2024 • 100
view article Article A failed experiment: Infini-Attention, and why we should keep trying? Aug 14, 2024 • 60
view article Article Welcome FalconMamba: The first strong attention-free 7B model Aug 12, 2024 • 109