monsoon-nlp commited on
Commit
6924d3e
1 Parent(s): ce955e5

better finetuned run

Browse files
Files changed (1) hide show
  1. README.md +2 -4
README.md CHANGED
@@ -18,7 +18,7 @@ Notebook - Finetuning on Maldivian news classification task: https://colab.resea
18
  Current performance:
19
 
20
  - mBERT: 52%
21
- - byt5-dv (first run): 78%
22
  - dv-wave (ELECTRA): 89%
23
  - dv-muril: 90.7%
24
  - dv-labse: 91.3-91.5%
@@ -33,6 +33,4 @@ as one TFDS dataset.
33
 
34
  This is based on ByT5-small ... we should try a larger model
35
 
36
- This needs more time for pretraining
37
-
38
- This needs better finetuning (reformatting batches to get all training data)
 
18
  Current performance:
19
 
20
  - mBERT: 52%
21
+ - **byt5-dv**: 81%
22
  - dv-wave (ELECTRA): 89%
23
  - dv-muril: 90.7%
24
  - dv-labse: 91.3-91.5%
 
33
 
34
  This is based on ByT5-small ... we should try a larger model
35
 
36
+ This needs more time for pretraining