Update README.md
Browse files
README.md
CHANGED
@@ -463,6 +463,21 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
|
|
463 |
|
464 |
### Low-Resource Languages of Spain
|
465 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
466 |
#### Spanish-XX
|
467 |
|
468 |
| | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
|
@@ -470,7 +485,7 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
|
|
470 |
| SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
|
471 |
| SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
|
472 |
| salamandraTA2B | es | ast | 16.68 | 77.29 | 49.46 |
|
473 |
-
|
|
474 |
| | | | | | |
|
475 |
| SalamandraTA-7b-base | es | arn | **29.19** | **71.85** | **49.42** |
|
476 |
| SalamandraTA-7b-instruct | es | arn | 26.82 | 74.04 | 47.55 |
|
@@ -489,7 +504,7 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
|
|
489 |
| SalamandraTA-7b-instruct | ca | ast | **27.86** | **58.19** | 57.98 |
|
490 |
| SalamandraTA-7b-base | ca | ast | 26.11 | 63.63 | **58.08** |
|
491 |
| salamandraTA2B | ca | ast | 25.32 | 62.59 | 55.98 |
|
492 |
-
|
|
493 |
| | | | | | |
|
494 |
| SalamandraTA-7b-base | ca | arn | **17.77** | **80.88** | **42.12** |
|
495 |
| SalamandraTA-7b-instruct | ca | arn | 16.45 | 82.01 | 41.04 |
|
@@ -500,6 +515,7 @@ Below are the evaluation results on the Flores+200 devtest set, compared against
|
|
500 |
| salamandraTA2B | ca | arg | 18.6 | 65.82 | 51.21 |
|
501 |
|
502 |
|
|
|
503 |
## Ethical Considerations and Limitations
|
504 |
|
505 |
Detailed information on the work done to examine the presence of unwanted social and cognitive biases in the base model can be found
|
|
|
463 |
|
464 |
### Low-Resource Languages of Spain
|
465 |
|
466 |
+
#### English-XX
|
467 |
+
|
468 |
+
| | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
|
469 |
+
|:---------------------------------|:---------|:---------|-------:|-------:|-------:|
|
470 |
+
| SalamandraTA-7b-instruct | en | ast | **31.49** | **54.01** | **60.65** |
|
471 |
+
| SalamandraTA-7b-base | en | ast | 26.4 | 64.02 | 57.35 |
|
472 |
+
| nllb-3.3B | en | ast | 22.02 | 77.26 | 51.4 |
|
473 |
+
| | | | | | |
|
474 |
+
| SalamandraTA-7b-instruct | en | arn | **13.04** | **87.13** | **37.56** |
|
475 |
+
| SalamandraTA-7b-base | en | arn | 8.36 | 90.85 | 34.06 |
|
476 |
+
| | | | | | |
|
477 |
+
| SalamandraTA-7b-instruct | en | arg | **20.43** | **65.62** | **50.79** |
|
478 |
+
| SalamandraTA-7b-base | en | arg | 12.24 | 73.48 | 44.75 |
|
479 |
+
|
480 |
+
|
481 |
#### Spanish-XX
|
482 |
|
483 |
| | Source | Target | Bleu↑ | Ter↓ | ChrF↑ |
|
|
|
485 |
| SalamandraTA-7b-instruct | es | ast | **21.28** | **68.11** | **52.73** |
|
486 |
| SalamandraTA-7b-base | es | ast | 17.65 | 75.78 | 51.05 |
|
487 |
| salamandraTA2B | es | ast | 16.68 | 77.29 | 49.46 |
|
488 |
+
| nllb-3.3B | es | ast | 11.85 | 100.86 | 40.27 |
|
489 |
| | | | | | |
|
490 |
| SalamandraTA-7b-base | es | arn | **29.19** | **71.85** | **49.42** |
|
491 |
| SalamandraTA-7b-instruct | es | arn | 26.82 | 74.04 | 47.55 |
|
|
|
504 |
| SalamandraTA-7b-instruct | ca | ast | **27.86** | **58.19** | 57.98 |
|
505 |
| SalamandraTA-7b-base | ca | ast | 26.11 | 63.63 | **58.08** |
|
506 |
| salamandraTA2B | ca | ast | 25.32 | 62.59 | 55.98 |
|
507 |
+
| nllb-3.3B | ca | ast | 17.17 | 91.47 | 45.83 |
|
508 |
| | | | | | |
|
509 |
| SalamandraTA-7b-base | ca | arn | **17.77** | **80.88** | **42.12** |
|
510 |
| SalamandraTA-7b-instruct | ca | arn | 16.45 | 82.01 | 41.04 |
|
|
|
515 |
| salamandraTA2B | ca | arg | 18.6 | 65.82 | 51.21 |
|
516 |
|
517 |
|
518 |
+
|
519 |
## Ethical Considerations and Limitations
|
520 |
|
521 |
Detailed information on the work done to examine the presence of unwanted social and cognitive biases in the base model can be found
|