gao-NLP
/

llama3-chinese-8B-base

Model card Files Files and versions Community

llama3-chinese-8B-base / README.md

gao-NLP's picture

update readme.md

96e7c77 verified 6 months ago

|

history blame contribute delete

266 Bytes

metadata

license: apache-2.0
language:
  - zh
  - en

对llama-3-8B-base 使用wudao200G语料做中文全参预训练

github https://github.com/cooper12121/llama3-Chinese

20G表示用20G语料训练得到的checkpoint