metadata
language:
- ru
- en
- be
- bg
- uk
- ro
- kz
- tg
- tat
- sv
- sl
- sr
- uz
- es
- fi
tags:
- russian
- fill-mask
- pretraining
- embeddings
- masked-lm
license: mit
widget:
- text: '[MASK] категории С'
This is a distilled Herbert model for an mlm task.
Sentence embeddings can be produced as follows:
# pip install transformers
from transformers import pipeline
fill_mask = pipeline(
"fill-mask",
model='RabotaRu/HRBert-mini',
tokenizer='RabotaRu/HRBert-mini'
)
fill_mask('требуется <mask> менеджер')