language: | |
- ru | |
tags: | |
- PyTorch | |
- Transformers | |
- bert | |
- exbert | |
pipeline: fill-mask | |
thumbnail: "https://github.com/sberbank-ai/model-zoo" | |
license: apache-2.0 | |
# ruBert-large | |
Model was trained by [SberDevices](https://sberdevices.ru/) team. | |
* Task: `mask filling` | |
* Type: `encoder` | |
* Tokenizer: `bpe` | |
* Dict size: `120 138` | |
* Num Parameters: `178 M` | |
* Training Data Volume `30 GB` |