| language: | |
| - ru | |
| tags: | |
| - PyTorch | |
| - Transformers | |
| thumbnail: "https://github.com/sberbank-ai/model-zoo" | |
| # ruRoberta-large | |
| Model was trained by [SberDevices](https://sberdevices.ru/) team. | |
| * Task: `mask filling` | |
| * Type: `encoder` | |
| * Tokenizer: `bbpe` | |
| * Dict size: `50 257` | |
| * Num Parameters: `355 M` | |
| * Training Data Volume `250 GB` | |
| # Authors | |
| + NLP core team RnD [Telegram channel](https://t.me/nlpcoreteam): | |
| + Dmitry Zmitrovich |