|
--- |
|
language: vi |
|
|
|
datasets: |
|
- oscar |
|
|
|
--- |
|
|
|
# NlpHUST/roberta-base-vn |
|
|
|
## Model description |
|
|
|
This is a Vietnamese RoBERTa base model pretrained on Vietnamese Oscar dataset. |
|
|
|
## How to use |
|
|
|
You can use this model for masked language modeling as follows: |
|
```python |
|
from transformers import AutoTokenizer, AutoModelForMaskedLM |
|
tokenizer = AutoTokenizer.from_pretrained("NlpHUST/roberta-base-vn") |
|
model = AutoModelForMaskedLM.from_pretrained("NlpHUST/roberta-base-vn") |
|
|
|
You can fine-tune this model on downstream tasks. |
|
|
