Commit
•
69ff9d4
1
Parent(s):
28da25c
Update README.md
Browse files
README.md
CHANGED
|
@@ -28,7 +28,7 @@ See the benchmark results, or even better, download the model and try it yoursel
|
|
| 28 |
Here, we demonstrate results of benchmark that is not frequently performed, yet equally important: how adapting the model for a new language impacted its original English-only performance.
|
| 29 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/617bbeec14572ebe9e6ea83f/IPY0myfQI-Ne5x6b11glz.png" width="100%" height="100%">
|
| 30 |
|
| 31 |
-
*All evals are performed in zero shot manner.
|
| 32 |
*Also bear in mind that llama-2-7b, llama-3-8b and mistral-7b models compared to Prodigy SM base aren't trained on extensive Serbian language datasets, and these benchmarks demonstrate how primarily English models can be adapted to other languages.
|
| 33 |
|
| 34 |
So, as you can see, we successfully improved the original model's performance for Serbian language use cases while retaining or even slightly improving its performance for English language.
|
|
|
|
| 28 |
Here, we demonstrate results of benchmark that is not frequently performed, yet equally important: how adapting the model for a new language impacted its original English-only performance.
|
| 29 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/617bbeec14572ebe9e6ea83f/IPY0myfQI-Ne5x6b11glz.png" width="100%" height="100%">
|
| 30 |
|
| 31 |
+
*All evals are performed in zero shot manner.
|
| 32 |
*Also bear in mind that llama-2-7b, llama-3-8b and mistral-7b models compared to Prodigy SM base aren't trained on extensive Serbian language datasets, and these benchmarks demonstrate how primarily English models can be adapted to other languages.
|
| 33 |
|
| 34 |
So, as you can see, we successfully improved the original model's performance for Serbian language use cases while retaining or even slightly improving its performance for English language.
|