aisingapore
/

llama3-8b-cpt-sea-lionv2-base

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

tainc commited on Aug 2

Commit

dfd0674

•

1 Parent(s): af197ab

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -49,7 +49,6 @@ We also evaluated the model on English capabilities using tasks from the Open LL
 | Model                                     | ARC   | BBH   | HellaSwag | MMLU  | GSM8k | Average |
 | ----------------------------------------- |:-----:|:-----:|:---------:|:-----:|:-----:|:-------:|
 | Qwen/Qwen2-7B                             | 61.86 | 53.10 | 80.63     | 70.45 | 78.09 | 68.83   |
-| google/gemma-2-9b                         | 68.00 | 53.53 | 82.73     | 70.26 | 63.53 | 67.61   |
 | aisingapore/llama3-8b-cpt-sea-lionv2-base | 58.87 | 47.70 | 81.14     | 63.11 | 50.49 | 60.26   |
 | meta-llama/Meta-Llama-3-8B                | 57.85 | 46.09 | 81.89     | 65.10 | 45.34 | 59.25   |
 | mistralai/Mistral-7B-v0.3                 | 59.56 | 44.89 | 82.97     | 62.36 | 33.36 | 56.63   |

 | Model                                     | ARC   | BBH   | HellaSwag | MMLU  | GSM8k | Average |
 | ----------------------------------------- |:-----:|:-----:|:---------:|:-----:|:-----:|:-------:|
 | Qwen/Qwen2-7B                             | 61.86 | 53.10 | 80.63     | 70.45 | 78.09 | 68.83   |
 | aisingapore/llama3-8b-cpt-sea-lionv2-base | 58.87 | 47.70 | 81.14     | 63.11 | 50.49 | 60.26   |
 | meta-llama/Meta-Llama-3-8B                | 57.85 | 46.09 | 81.89     | 65.10 | 45.34 | 59.25   |
 | mistralai/Mistral-7B-v0.3                 | 59.56 | 44.89 | 82.97     | 62.36 | 33.36 | 56.63   |