|
--- |
|
language: |
|
- dsb |
|
- cs |
|
- csb_Latn |
|
- hsb |
|
- pl |
|
- zlw |
|
- hu |
|
- vro |
|
- fi |
|
- liv_Latn |
|
- mdf |
|
- krl |
|
- fkv_Latn |
|
- mhr |
|
- et |
|
- sma |
|
- udm |
|
- vep |
|
- myv |
|
- kpv |
|
- se |
|
- izh |
|
- fiu |
|
|
|
tags: |
|
- translation |
|
|
|
license: apache-2.0 |
|
--- |
|
### zlw-fiu |
|
* source language name: West Slavic languages |
|
* target language name: Finno-Ugrian languages |
|
* OPUS readme: [README.md](https://object.pouta.csc.fi/Tatoeba-MT-models/zlw-fiu/README.md) |
|
* model: transformer |
|
* source language codes: dsb, cs, csb_Latn, hsb, pl, zlw |
|
* target language codes: hu, vro, fi, liv_Latn, mdf, krl, fkv_Latn, mhr, et, sma, udm, vep, myv, kpv, se, izh, fiu |
|
* dataset: opus |
|
* release date: 2021-02-18 |
|
* pre-processing: normalization + SentencePiece (spm32k,spm32k) |
|
* download original weights: [opus-2021-02-18.zip](https://object.pouta.csc.fi/Tatoeba-MT-models/zlw-fiu/opus-2021-02-18.zip/zlw-fiu/opus-2021-02-18.zip) |
|
* a sentence-initial language token is required in the form of >>id<<(id = valid, usually three-letter target language ID) |
|
* Training data: |
|
* ces-fin: Tatoeba-train (1000000) |
|
* ces-hun: Tatoeba-train (1000000) |
|
* pol-est: Tatoeba-train (1000000) |
|
* pol-fin: Tatoeba-train (1000000) |
|
* pol-hun: Tatoeba-train (1000000) |
|
* Validation data: |
|
* ces-fin: Tatoeba-dev, 1000 |
|
* ces-hun: Tatoeba-dev, 1000 |
|
* est-pol: Tatoeba-dev, 1000 |
|
* fin-pol: Tatoeba-dev, 1000 |
|
* hun-pol: Tatoeba-dev, 1000 |
|
* mhr-pol: Tatoeba-dev, 461 |
|
* total-size-shuffled: 5426 |
|
* devset-selected: top 5000 lines of Tatoeba-dev.src.shuffled! |
|
* Test data: |
|
* newssyscomb2009.ces-hun: 502/9733 |
|
* newstest2009.ces-hun: 2525/54965 |
|
* Tatoeba-test.ces-fin: 88/408 |
|
* Tatoeba-test.ces-hun: 1911/10336 |
|
* Tatoeba-test.multi-multi: 4562/25497 |
|
* Tatoeba-test.pol-chm: 5/36 |
|
* Tatoeba-test.pol-est: 15/98 |
|
* Tatoeba-test.pol-fin: 609/3293 |
|
* Tatoeba-test.pol-hun: 1934/11285 |
|
* test set translations file: [test.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/zlw-fiu/opus-2021-02-18.zip/zlw-fiu/opus-2021-02-18.test.txt) |
|
* test set scores file: [eval.txt](https://object.pouta.csc.fi/Tatoeba-MT-models/zlw-fiu/opus-2021-02-18.zip/zlw-fiu/opus-2021-02-18.eval.txt) |
|
* BLEU-scores |
|
|Test set|score| |
|
|---|---| |
|
|Tatoeba-test.ces-fin|57.2| |
|
|Tatoeba-test.ces-hun|42.6| |
|
|Tatoeba-test.multi-multi|39.4| |
|
|Tatoeba-test.pol-hun|36.6| |
|
|Tatoeba-test.pol-fin|36.1| |
|
|Tatoeba-test.pol-est|20.9| |
|
|newssyscomb2009.ces-hun|13.9| |
|
|newstest2009.ces-hun|13.9| |
|
|Tatoeba-test.pol-chm|2.0| |
|
* chr-F-scores |
|
|Test set|score| |
|
|---|---| |
|
|Tatoeba-test.ces-fin|0.71| |
|
|Tatoeba-test.ces-hun|0.637| |
|
|Tatoeba-test.multi-multi|0.616| |
|
|Tatoeba-test.pol-hun|0.605| |
|
|Tatoeba-test.pol-fin|0.592| |
|
|newssyscomb2009.ces-hun|0.449| |
|
|newstest2009.ces-hun|0.443| |
|
|Tatoeba-test.pol-est|0.372| |
|
|Tatoeba-test.pol-chm|0.007| |
|
|
|
### System Info: |
|
* hf_name: zlw-fiu |
|
* source_languages: dsb,cs,csb_Latn,hsb,pl,zlw |
|
* target_languages: hu,vro,fi,liv_Latn,mdf,krl,fkv_Latn,mhr,et,sma,udm,vep,myv,kpv,se,izh,fiu |
|
* opus_readme_url: https://object.pouta.csc.fi/Tatoeba-MT-models/zlw-fiu/opus-2021-02-18.zip/README.md |
|
* original_repo: Tatoeba-Challenge |
|
* tags: ['translation'] |
|
* languages: ['dsb', 'cs', 'csb_Latn', 'hsb', 'pl', 'zlw', 'hu', 'vro', 'fi', 'liv_Latn', 'mdf', 'krl', 'fkv_Latn', 'mhr', 'et', 'sma', 'udm', 'vep', 'myv', 'kpv', 'se', 'izh', 'fiu'] |
|
* src_constituents: ['dsb', 'ces', 'csb_Latn', 'hsb', 'pol'] |
|
* tgt_constituents: ['hun', 'vro', 'fin', 'liv_Latn', 'mdf', 'krl', 'fkv_Latn', 'mhr', 'est', 'sma', 'udm', 'vep', 'myv', 'kpv', 'sme', 'izh'] |
|
* src_multilingual: True |
|
* tgt_multilingual: True |
|
* helsinki_git_sha: a0966db6db0ae616a28471ff0faf461b36fec07d |
|
* transformers_git_sha: 3857f2b4e34912c942694489c2b667d9476e55f5 |
|
* port_machine: bungle |
|
* port_time: 2021-06-29-15:24 |
