hazyresearch
/

lolcats-llama-3.1-405b

Model card Files Files and versions Community

Edit model card

This is a pure sub-quadtratic linear attention 405B parameter model, linearized from the Meta Llama 3.1 405B model.

Details on this model are provided at: https://github.com/HazyResearch/lolcats/tree/lolcats-scaled

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .

Collection including hazyresearch/lolcats-llama-3.1-405b

LoLCATS

Linearizing LLMs with high quality and efficiency. We linearize the full Llama 3.1 model family -- 8b, 70b, 405b -- for the first time! • 4 items • Updated Oct 14 • 14