Add performance metrics
Browse files
README.md
CHANGED
|
@@ -139,7 +139,83 @@ PRON VERB SCONJ ADP CCONJ DET NOUN ADJ AUX ADV PUNCT PROPN NUM SYM PART X INTJ
|
|
| 139 |
| MOTINC | Unknown words | Technology Lady |
|
| 140 |
| X | Typos & others | sfeir 3D statu |
|
| 141 |
|
| 142 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 143 |
|
| 144 |
Please cite the following paper when using this model.
|
| 145 |
|
|
|
|
| 139 |
| MOTINC | Unknown words | Technology Lady |
|
| 140 |
| X | Typos & others | sfeir 3D statu |
|
| 141 |
|
| 142 |
+
## Evaluation Metrics
|
| 143 |
+
|
| 144 |
+
```plain
|
| 145 |
+
Results:
|
| 146 |
+
- F-score (micro): 0.952
|
| 147 |
+
- F-score (macro): 0.8644
|
| 148 |
+
- Accuracy (incl. no class): 0.952
|
| 149 |
+
|
| 150 |
+
By class:
|
| 151 |
+
precision recall f1-score support
|
| 152 |
+
PPER1S 0.9767 1.0000 0.9882 42
|
| 153 |
+
VERB 0.9823 0.9537 0.9678 583
|
| 154 |
+
COSUB 0.9344 0.8906 0.9120 128
|
| 155 |
+
PUNCT 0.9878 0.9688 0.9782 833
|
| 156 |
+
PREP 0.9767 0.9879 0.9822 1483
|
| 157 |
+
PDEMMS 0.9583 0.9200 0.9388 75
|
| 158 |
+
COCO 0.9839 1.0000 0.9919 245
|
| 159 |
+
DET 0.9679 0.9814 0.9746 645
|
| 160 |
+
NMP 0.9521 0.9115 0.9313 305
|
| 161 |
+
ADJMP 0.8352 0.9268 0.8786 82
|
| 162 |
+
PREL 0.9324 0.9857 0.9583 70
|
| 163 |
+
PREFP 0.9767 0.9545 0.9655 44
|
| 164 |
+
AUX 0.9537 0.9859 0.9695 355
|
| 165 |
+
ADV 0.9440 0.9365 0.9402 504
|
| 166 |
+
VPPMP 0.8667 1.0000 0.9286 26
|
| 167 |
+
DINTMS 0.9919 1.0000 0.9959 122
|
| 168 |
+
ADJMS 0.9020 0.9057 0.9039 244
|
| 169 |
+
NMS 0.9226 0.9336 0.9281 753
|
| 170 |
+
NFS 0.9347 0.9714 0.9527 560
|
| 171 |
+
YPFOR 0.9806 1.0000 0.9902 353
|
| 172 |
+
PINDMS 1.0000 0.9091 0.9524 44
|
| 173 |
+
NOUN 0.8400 0.5385 0.6562 39
|
| 174 |
+
PROPN 0.8605 0.8278 0.8439 395
|
| 175 |
+
DETMS 0.9972 0.9972 0.9972 362
|
| 176 |
+
PPER3MS 0.9341 0.9770 0.9551 87
|
| 177 |
+
VPPMS 0.8994 0.9682 0.9325 157
|
| 178 |
+
DETFS 1.0000 1.0000 1.0000 240
|
| 179 |
+
ADJFS 0.9266 0.9011 0.9136 182
|
| 180 |
+
ADJFP 0.9726 0.9342 0.9530 76
|
| 181 |
+
NFP 0.9463 0.9749 0.9604 199
|
| 182 |
+
VPPFS 0.8000 0.9000 0.8471 40
|
| 183 |
+
CHIF 0.9543 0.9414 0.9478 222
|
| 184 |
+
XFAMIL 0.9346 0.8696 0.9009 115
|
| 185 |
+
PPER3MP 0.9474 0.9000 0.9231 20
|
| 186 |
+
PPOBJMS 0.8800 0.9362 0.9072 47
|
| 187 |
+
PREF 0.8889 0.9231 0.9057 52
|
| 188 |
+
PPOBJMP 1.0000 0.6000 0.7500 10
|
| 189 |
+
SYM 0.9706 0.8684 0.9167 38
|
| 190 |
+
DINTFS 0.9683 1.0000 0.9839 61
|
| 191 |
+
PDEMFS 1.0000 0.8966 0.9455 29
|
| 192 |
+
PPER3FS 1.0000 0.9444 0.9714 18
|
| 193 |
+
VPPFP 0.9500 1.0000 0.9744 19
|
| 194 |
+
PRON 0.9200 0.7419 0.8214 31
|
| 195 |
+
PPOBJFS 0.8333 0.8333 0.8333 6
|
| 196 |
+
PART 0.8000 1.0000 0.8889 4
|
| 197 |
+
PPER3FP 1.0000 1.0000 1.0000 2
|
| 198 |
+
MOTINC 0.3571 0.3333 0.3448 15
|
| 199 |
+
PDEMMP 1.0000 0.6667 0.8000 3
|
| 200 |
+
INTJ 0.4000 0.6667 0.5000 6
|
| 201 |
+
PREFS 1.0000 0.5000 0.6667 10
|
| 202 |
+
ADJ 0.7917 0.8636 0.8261 22
|
| 203 |
+
PINDMP 0.0000 0.0000 0.0000 1
|
| 204 |
+
PINDFS 1.0000 1.0000 1.0000 1
|
| 205 |
+
NUM 1.0000 0.3333 0.5000 3
|
| 206 |
+
PPER2S 1.0000 1.0000 1.0000 2
|
| 207 |
+
PPOBJFP 1.0000 0.5000 0.6667 2
|
| 208 |
+
PDEMFP 1.0000 0.6667 0.8000 3
|
| 209 |
+
X 0.0000 0.0000 0.0000 1
|
| 210 |
+
PRELMS 1.0000 1.0000 1.0000 2
|
| 211 |
+
PINDFP 1.0000 1.0000 1.0000 1
|
| 212 |
+
|
| 213 |
+
accuracy 0.9520 10019
|
| 214 |
+
macro avg 0.8956 0.8521 0.8644 10019
|
| 215 |
+
weighted avg 0.9524 0.9520 0.9515 10019
|
| 216 |
+
```
|
| 217 |
+
|
| 218 |
+
## Citations
|
| 219 |
|
| 220 |
Please cite the following paper when using this model.
|
| 221 |
|