Update README.md
Browse filesAdd HR std NER scores
README.md
CHANGED
@@ -18,7 +18,18 @@ Three tasks were chosen for model evaluation:
|
|
18 |
|
19 |
In all cases, this model was finetuned for specific downstream tasks.
|
20 |
## NER
|
21 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
## Sentiment regression
|
23 |
|
24 |
[ParlaSent dataset](https://huggingface.co/datasets/classla/ParlaSent) was used to evaluate sentiment regression for Bosnian, Croatian, and Serbian languages.
|
|
|
18 |
|
19 |
In all cases, this model was finetuned for specific downstream tasks.
|
20 |
## NER
|
21 |
+
Mean F1 scores were used to evaluate performance.
|
22 |
+
|
23 |
+
| system | dataset | F1 score |
|
24 |
+
|:-----------------------------------------------------------------------|:----|------:|
|
25 |
+
| [BERTić](https://huggingface.co/classla/bcms-bertic) | hr500k | 0.925 |
|
26 |
+
| **XLM-R-BERTić** | hr500k | 0.927 |
|
27 |
+
| XLM-R-SloBERTić | hr500k | 0.923 |
|
28 |
+
| XLM-Roberta-Large |hr500k | 0.919 |
|
29 |
+
| [crosloengual-bert](https://huggingface.co/EMBEDDIA/crosloengual-bert) | hr500k | 0.918 |
|
30 |
+
| XLM-Roberta-Base | hr500k | 0.903 |
|
31 |
+
|
32 |
+
|
33 |
## Sentiment regression
|
34 |
|
35 |
[ParlaSent dataset](https://huggingface.co/datasets/classla/ParlaSent) was used to evaluate sentiment regression for Bosnian, Croatian, and Serbian languages.
|