Hugging Face's logo

xiaol
/
rwkv-7B-world-novel-128k

Model card Files Community
2
xiaol commited on
Commit
55faadc
•
1 Parent(s): 8014230

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -6,7 +6,7 @@ We proudly announce this is the world first 128k context model based on RWKV arc
6
  This model trained with instructions datasets and chinese web novel and tradition wuxia,
7
  more trainning details would be updated.
8
 
9
- Full finetuned using this repo to train 128k context model
10
  https://github.com/SynthiaDL/TrainChatGalRWKV/blob/main/train_world.sh
11
  ![QQ图片20230810144654.jpg](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/KjeXNjryiZjKH0PsnrE6J.jpeg)
12
 
 
6
  This model trained with instructions datasets and chinese web novel and tradition wuxia,
7
  more trainning details would be updated.
8
 
9
+ Full finetuned using this repo to train 128k context model , 4*A800 40hours with 4B tokens.
10
  https://github.com/SynthiaDL/TrainChatGalRWKV/blob/main/train_world.sh
11
  ![QQ图片20230810144654.jpg](https://cdn-uploads.huggingface.co/production/uploads/6176b32847ee6431f632981e/KjeXNjryiZjKH0PsnrE6J.jpeg)
12