Collection by
May 1
May 1
-
Larimar: Large Language Models with Episodic Memory Control
Paper • 2403.11901 • Published • 30 -
Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints
Paper • 2212.05055 • Published • 5 -
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
Paper • 2404.02258 • Published • 102 -
Multi-Head Mixture-of-Experts
Paper • 2404.15045 • Published • 55
