Helsinki-NLP/opus-mt-sem-sem

sem-sem

• source group: Semitic languages

• target group: Semitic languages

• OPUS readme: sem-sem

• model: transformer

• source language(s): apc ara arq arz heb mlt

• target language(s): apc ara arq arz heb mlt

• model: transformer

• pre-processing: normalization + SentencePiece (spm32k,spm32k)

• a sentence initial language token is required in the form of >>id<< (id = valid target language ID)

• download original weights: opus-2020-07-27.zip

• test set translations: opus-2020-07-27.test.txt

• test set scores: opus-2020-07-27.eval.txt

Benchmarks

testset	BLEU	chr-F
Tatoeba-test.ara-ara.ara.ara	4.2	0.200
Tatoeba-test.ara-heb.ara.heb	34.0	0.542
Tatoeba-test.ara-mlt.ara.mlt	16.6	0.513
Tatoeba-test.heb-ara.heb.ara	18.8	0.477
Tatoeba-test.mlt-ara.mlt.ara	20.7	0.388
Tatoeba-test.multi.multi	27.1	0.507

System Info:

• hf_name: sem-sem

• source_languages: sem

• target_languages: sem

• opus_readme_url: https://github.com/Helsinki-NLP/Tatoeba-Challenge/tree/master/models/sem-sem/README.md

• original_repo: Tatoeba-Challenge

• tags: ['translation']

• languages: ['mt', 'ar', 'he', 'ti', 'am', 'sem']

• src_constituents: {'apc', 'mlt', 'arz', 'ara', 'heb', 'tir', 'arq', 'afb', 'amh', 'acm', 'ary'}

• tgt_constituents: {'apc', 'mlt', 'arz', 'ara', 'heb', 'tir', 'arq', 'afb', 'amh', 'acm', 'ary'}

• src_multilingual: True

• tgt_multilingual: True

• prepro: normalization + SentencePiece (spm32k,spm32k)

• url_model: https://object.pouta.csc.fi/Tatoeba-MT-models/sem-sem/opus-2020-07-27.zip

• url_test_set: https://object.pouta.csc.fi/Tatoeba-MT-models/sem-sem/opus-2020-07-27.test.txt

• src_alpha3: sem

• tgt_alpha3: sem

• short_pair: sem-sem

• chrF2_score: 0.507

• bleu: 27.1

• brevity_penalty: 0.972

• ref_len: 13472.0

• src_name: Semitic languages

• tgt_name: Semitic languages

• train_date: 2020-07-27

• src_alpha2: sem

• tgt_alpha2: sem

• prefer_old: False

• long_pair: sem-sem

• helsinki_git_sha: 480fcbe0ee1bf4774bcbe6226ad9f58e63f6c535

• transformers_git_sha: 2207e5d8cb224e954a7cba69fa4ac2309e9ff30b

• port_machine: brutasse

• port_time: 2020-08-21-14:41