---
license: cc-by-sa-4.0
---

# LLaMA-7B + Landmark Attention

This repo hosts the weight diff between LLaMA 7B trained with landmark attention for 15000 steps on RedPajama and the original model. Please visit the [Github repository](https://github.com/epfml/landmark-attention) for further instructions on how to recover the full weights and how to use them.

Github repository: <https://github.com/epfml/landmark-attention>