mistralai
/

Mistral-Small-3.1-24B-Instruct-2503

Model card Files Files and versions Community

Fix benchmark GPT-4o-mini

#3

by dr-e - opened 1 day ago

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -104,7 +104,7 @@ When available, we report numbers previously published by other model providers,
 |--------------------------------|------------|------------|------------|----------------|
 | **Small 3.1 24B Instruct**     | **71.18%** | **75.30%** | **69.17%** | 69.08%         |
 | Gemma 3 27B IT                 | 70.19%     | 74.14%     | 65.65%     | 70.76%         |
-| GPT4o Mini                     | 79.36%     | 74.21%     | 65.96%     | **70.90%**     |
 | Claude 3.5 Haiku               | 70.16%     | 73.45%     | 67.05%     | 70.00%         |
 | Cohere Aya-Vision 32B          | 62.15%     | 64.70%     | 57.61%     | 64.12%         |

 |--------------------------------|------------|------------|------------|----------------|
 | **Small 3.1 24B Instruct**     | **71.18%** | **75.30%** | **69.17%** | 69.08%         |
 | Gemma 3 27B IT                 | 70.19%     | 74.14%     | 65.65%     | 70.76%         |
+| GPT4o Mini                     | 70.36%     | 74.21%     | 65.96%     | **70.90%**     |
 | Claude 3.5 Haiku               | 70.16%     | 73.45%     | 67.05%     | 70.00%         |
 | Cohere Aya-Vision 32B          | 62.15%     | 64.70%     | 57.61%     | 64.12%         |