javi8979 commited on
Commit
c2371e6
·
verified ·
1 Parent(s): 37440a7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -1
README.md CHANGED
@@ -465,7 +465,7 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
465
 
466
  #### Spanish-XX
467
 
468
- | | source | target | bleu | ter | chrf |
469
  |:---------------------------------|:---------|:---------|-------:|-------:|-------:|
470
  | SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
471
  | SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
@@ -480,6 +480,26 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
480
  | SalamandraTA-7b-instruct | es | arg | 47.54 | 36.57 | 72.38 |
481
  | salamandraTA2B | es | arg | 44.57 | 37.93 | 71.32 |
482
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
483
  ## Ethical Considerations and Limitations
484
 
485
  Detailed information on the work done to examine the presence of unwanted social and cognitive biases in the base model can be found
 
465
 
466
  #### Spanish-XX
467
 
468
+ | | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
469
  |:---------------------------------|:---------|:---------|-------:|-------:|-------:|
470
  | SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
471
  | SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
 
480
  | SalamandraTA-7b-instruct | es | arg | 47.54 | 36.57 | 72.38 |
481
  | salamandraTA2B | es | arg | 44.57 | 37.93 | 71.32 |
482
 
483
+
484
+ #### Catalan-XX
485
+
486
+
487
+ | | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
488
+ |:---------------------------------|:---------|:---------|-------:|-------:|-------:|
489
+ | SalamandraTA-7b-instruct | ca | ast | **27.86** | **58.19** | 57.98 |
490
+ | SalamandraTA-7b-base | ca | ast | 26.11 | 63.63 | **58.08** |
491
+ | salamandraTA2B | ca | ast | 25.32 | 62.59 | 55.98 |
492
+ | nllb_3.3B | ca | ast | 17.17 | 91.47 | 45.83 |
493
+ | | | | | | |
494
+ | SalamandraTA-7b-base | ca | arn | **17.77** | **80.88** | **42.12** |
495
+ | SalamandraTA-7b-instruct | ca | arn | 16.45 | 82.01 | 41.04 |
496
+ | salamandraTA2B | ca | arn | 15.37 | 82.76 | 40.53 |
497
+ | | | | | | |
498
+ | SalamandraTA-7b-base | ca | arg | **22.53** | **62.37** | **54.32** |
499
+ | SalamandraTA-7b-instruct | ca | arg | 21.62 | 63.38 | 53.01 |
500
+ | salamandraTA2B | ca | arg | 18.6 | 65.82 | 51.21 |
501
+
502
+
503
  ## Ethical Considerations and Limitations
504
 
505
  Detailed information on the work done to examine the presence of unwanted social and cognitive biases in the base model can be found