Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ We proudly announce this is the world first 128k context model based on RWKV arc
|
|
9 |
This model trained with instructions datasets and chinese web novel and tradition wuxia,
|
10 |
more trainning details would be updated.
|
11 |
|
12 |
-
Test input 67k tokens to summary ,can find in example folders ,more cases are coming.
|
13 |
|
14 |
Full finetuned using this repo to train 128k context model , 4*A800 40hours with 1.3B tokens.
|
15 |
https://github.com/SynthiaDL/TrainChatGalRWKV/blob/main/train_world.sh
|
|
|
9 |
This model trained with instructions datasets and chinese web novel and tradition wuxia,
|
10 |
more trainning details would be updated.
|
11 |
|
12 |
+
Test input 67k tokens to summary ,can find conversation files in example folders ,more cases are coming.
|
13 |
|
14 |
Full finetuned using this repo to train 128k context model , 4*A800 40hours with 1.3B tokens.
|
15 |
https://github.com/SynthiaDL/TrainChatGalRWKV/blob/main/train_world.sh
|