Update README.md
Browse files
README.md
CHANGED
|
@@ -22,7 +22,7 @@ This is a Tamil instruction finetuned version of Google's Gemma 2B model. This i
|
|
| 22 |
|
| 23 |
> **Note:** This project is currently under development (FOR TAMIL). The initial pretraining phase may not have been extensive enough, which suggests that the model's performance could improve by extending the pretraining on a larger dataset, such as CulturaX.
|
| 24 |
|
| 25 |
-
### Benchmarks
|
| 26 |
|
| 27 |
This model outperforms Google's Gemma 2B base and instruct models on all benchmarks in Nous evaluation suite. It also surprisingly outperforms [mlabonne/Gemmalpaca-2B](https://huggingface.co/mlabonne/Gemmalpaca-2B) (the best performing 2B model in benchmarks as of Feb 25, 2024) despite being a model aimed at language adaptation.
|
| 28 |
|
|
|
|
| 22 |
|
| 23 |
> **Note:** This project is currently under development (FOR TAMIL). The initial pretraining phase may not have been extensive enough, which suggests that the model's performance could improve by extending the pretraining on a larger dataset, such as CulturaX.
|
| 24 |
|
| 25 |
+
### 🏆 Benchmarks
|
| 26 |
|
| 27 |
This model outperforms Google's Gemma 2B base and instruct models on all benchmarks in Nous evaluation suite. It also surprisingly outperforms [mlabonne/Gemmalpaca-2B](https://huggingface.co/mlabonne/Gemmalpaca-2B) (the best performing 2B model in benchmarks as of Feb 25, 2024) despite being a model aimed at language adaptation.
|
| 28 |
|