sberbank-ai
commited on
Commit
•
1e3415b
1
Parent(s):
f158b54
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,7 +14,7 @@ Model trained on a mixture of 7 denoisers like UL2 with several differences (htt
|
|
| 14 |
|
| 15 |
It trained on Russian language corpus (300GB). Dataset is the same as for ruT5 models.
|
| 16 |
|
| 17 |
-
Bbpe tokenizer. 50257 + special tokens 107. Prefix tokens: '
|
| 18 |
|
| 19 |
First half of the time model trained on the small part of all datasets (1%,3GB) and without prefixes in each task.
|
| 20 |
|
|
|
|
| 14 |
|
| 15 |
It trained on Russian language corpus (300GB). Dataset is the same as for ruT5 models.
|
| 16 |
|
| 17 |
+
Bbpe tokenizer. 50257 + special tokens 107. Prefix tokens: '\<LM\>', '\<SC1>',.. '\<SC6>'
|
| 18 |
|
| 19 |
First half of the time model trained on the small part of all datasets (1%,3GB) and without prefixes in each task.
|
| 20 |
|