JunxiongWang 's Collections

Mamba-In-Llama3

Mamba distilled from Llama3 8B Instruct. The Mamba in the Llama: Distilling and Accelerating Hybrid Models (https://arxiv.org/abs/2408.15237).