---
license: apache-2.0
datasets:
- EleutherAI/pile
- togethercomputer/RedPajama-Data-1T
- p208p2002/wudao
language:
- en
- zh
library_name: transformers
---

A language model distilled from an adapted version of LLaMA2-7B following this [paper]().