system HF staff commited on
Commit
eba8a49
1 Parent(s): d383201

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +111 -0
README.md ADDED
@@ -0,0 +1,111 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: fiu
3
+ tags:
4
+ - translation
5
+
6
+ license: apache-2.0
7
+ ---
8
+
9
+ ### fiu-eng
10
+
11
+ * source group: Finno-Ugrian languages
12
+ * target group: English
13
+ * OPUS readme: [fiu-eng](https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/fiu-eng/README.md)
14
+
15
+ * model: transformer
16
+ * source language(s): est fin fkv_Latn hun izh kpv krl liv_Latn mdf mhr myv sma sme udm vro
17
+ * target language(s): eng
18
+ * model: transformer
19
+ * pre-processing: normalization + SentencePiece (spm32k,spm32k)
20
+ * download original weights: [opus2m-2020-07-31.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/fiu-eng/opus2m-2020-07-31.zip)
21
+ * test set translations: [opus2m-2020-07-31.test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/fiu-eng/opus2m-2020-07-31.test.txt)
22
+ * test set scores: [opus2m-2020-07-31.eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/fiu-eng/opus2m-2020-07-31.eval.txt)
23
+
24
+ ## Benchmarks
25
+
26
+ | testset | BLEU | chr-F |
27
+ |-----------------------|-------|-------|
28
+ | newsdev2015-enfi-fineng.fin.eng | 22.9 | 0.513 |
29
+ | newsdev2018-enet-esteng.est.eng | 26.3 | 0.543 |
30
+ | newssyscomb2009-huneng.hun.eng | 21.2 | 0.494 |
31
+ | newstest2009-huneng.hun.eng | 19.8 | 0.486 |
32
+ | newstest2015-enfi-fineng.fin.eng | 24.1 | 0.521 |
33
+ | newstest2016-enfi-fineng.fin.eng | 25.6 | 0.541 |
34
+ | newstest2017-enfi-fineng.fin.eng | 28.7 | 0.560 |
35
+ | newstest2018-enet-esteng.est.eng | 26.5 | 0.549 |
36
+ | newstest2018-enfi-fineng.fin.eng | 21.2 | 0.490 |
37
+ | newstest2019-fien-fineng.fin.eng | 25.6 | 0.533 |
38
+ | newstestB2016-enfi-fineng.fin.eng | 21.6 | 0.500 |
39
+ | newstestB2017-enfi-fineng.fin.eng | 24.3 | 0.526 |
40
+ | newstestB2017-fien-fineng.fin.eng | 24.3 | 0.526 |
41
+ | Tatoeba-test.chm-eng.chm.eng | 1.2 | 0.163 |
42
+ | Tatoeba-test.est-eng.est.eng | 55.3 | 0.706 |
43
+ | Tatoeba-test.fin-eng.fin.eng | 48.7 | 0.660 |
44
+ | Tatoeba-test.fkv-eng.fkv.eng | 11.5 | 0.384 |
45
+ | Tatoeba-test.hun-eng.hun.eng | 46.7 | 0.638 |
46
+ | Tatoeba-test.izh-eng.izh.eng | 48.3 | 0.678 |
47
+ | Tatoeba-test.kom-eng.kom.eng | 0.7 | 0.113 |
48
+ | Tatoeba-test.krl-eng.krl.eng | 36.1 | 0.485 |
49
+ | Tatoeba-test.liv-eng.liv.eng | 2.1 | 0.086 |
50
+ | Tatoeba-test.mdf-eng.mdf.eng | 0.9 | 0.120 |
51
+ | Tatoeba-test.multi.eng | 47.8 | 0.648 |
52
+ | Tatoeba-test.myv-eng.myv.eng | 0.7 | 0.121 |
53
+ | Tatoeba-test.sma-eng.sma.eng | 1.7 | 0.101 |
54
+ | Tatoeba-test.sme-eng.sme.eng | 7.8 | 0.229 |
55
+ | Tatoeba-test.udm-eng.udm.eng | 0.9 | 0.166 |
56
+
57
+
58
+ ### System Info:
59
+ - hf_name: fiu-eng
60
+
61
+ - source_languages: fiu
62
+
63
+ - target_languages: eng
64
+
65
+ - opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/fiu-eng/README.md
66
+
67
+ - original_repo: Tatoeba-Challenge
68
+
69
+ - tags: ['translation']
70
+
71
+ - prepro: normalization + SentencePiece (spm32k,spm32k)
72
+
73
+ - url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/fiu-eng/opus2m-2020-07-31.zip
74
+
75
+ - url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/fiu-eng/opus2m-2020-07-31.test.txt
76
+
77
+ - src_alpha3: fiu
78
+
79
+ - tgt_alpha3: eng
80
+
81
+ - short_pair: fiu-en
82
+
83
+ - chrF2_score: 0.648
84
+
85
+ - bleu: 47.8
86
+
87
+ - brevity_penalty: 0.988
88
+
89
+ - ref_len: 71020.0
90
+
91
+ - src_name: Finno-Ugrian languages
92
+
93
+ - tgt_name: English
94
+
95
+ - train_date: 2020-07-31
96
+
97
+ - src_alpha2: fiu
98
+
99
+ - tgt_alpha2: en
100
+
101
+ - prefer_old: False
102
+
103
+ - long_pair: fiu-eng
104
+
105
+ - helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535
106
+
107
+ - transformers_git_sha: 46e9f53347bbe9e989f0335f98465f30886d8173
108
+
109
+ - port_machine: brutasse
110
+
111
+ - port_time: 2020-08-18-01:48