README.md

metadata

datasets:
  - leipzig
language:
  - hr
  - sr
  - multilingual
tags:
  - masked-lm
widget:
  - text: Gde je <mask>.
license: apache-2.0

Transformer language model for Croatian and Serbian

Trained on 0.7GB dataset Croatian and Serbian language for one epoch. Dataset from Leipzig Corpora.

Information of dataset

Model	#params	Arch.	Training data
Andrija/SRoBERTa	120M	First	Leipzig Corpus (0.7 GB of text)

How to use in code

from transformers import AutoTokenizer, AutoModelForMaskedLM
  
tokenizer = AutoTokenizer.from_pretrained("Andrija/SRoBERTa")

model = AutoModelForMaskedLM.from_pretrained("Andrija/SRoBERTa")