File size: 748 Bytes
8cdb89c
af3a0a0
 
8cdb89c
af3a0a0
 
8cdb89c
af3a0a0
 
1
2
3
4
5
6
7
8
9
10
Model description: fra-cat
Date: 2024-08-29
TF version 2.11.0, OpenNMT version 2.32.0, CTranslate2 version 3.22.0
Test data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 43.0 (μ = 43.0 ± 0.4) 69.5/49.4/37.7/29.3 (BP = 0.975 ratio = 0.975 hyp_len = 261302 ref_len = 267951)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 66.0 (μ = 66.0 ± 0.3)
Flores data set
  BLEU|nrefs:1|bs:1000|seed:12345|case:mixed|eff:no|tok:13a|smooth:exp|version:2.1.0 = 33.8 (μ = 33.7 ± 1.1) 63.1/39.8/27.2/19.0 (BP = 1.000 ratio = 1.006 hyp_len = 27479 ref_len = 27304)
chrF2|nrefs:1|bs:1000|seed:12345|case:mixed|eff:yes|nc:6|nw:0|space:no|version:2.1.0 = 60.0 (μ = 60.0 ± 0.7)