Update README.md
Browse files
README.md
CHANGED
@@ -29,7 +29,9 @@ datasets:
|
|
29 |
|
30 |
RWKV-4 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
31 |
|
32 |
-
Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
|
|
|
|
33 |
|
34 |
How to use:
|
35 |
* use https://github.com/josStorer/RWKV-Runner for GUI
|
|
|
29 |
|
30 |
RWKV-4 trained on 100+ world languages (70% English, 15% multilang, 15% code).
|
31 |
|
32 |
+
World = Some_Pile + Some_RedPajama + Some_OSCAR + All_Wikipedia + All_ChatGPT_Data_I_can_find
|
33 |
+
|
34 |
+
XXXtuned = finetune of World on MC4, OSCAR, wiki, etc.
|
35 |
|
36 |
How to use:
|
37 |
* use https://github.com/josStorer/RWKV-Runner for GUI
|