File size: 427 Bytes
9a6c679 1282675 9a6c679 0505628 |
1 2 3 4 5 6 7 8 9 10 |
---
license: cc-by-sa-4.0
---
# LLaMA-7B + Landmark Attention
This repo hosts the weight diff between LLaMA 7B trained with landmark attention for 15000 steps on RedPajama and the original model. Please visit the [Github repository](https://github.com/epfml/landmark-attention) for further instructions on how to recover the full weights and how to use them.
Github repository: <https://github.com/epfml/landmark-attention>
|