Adding Evaluation Results (#5)

- Adding Evaluation Results (52026696902197c3cc2c946435e99eec4587a1c3)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

README.md

@@ -1,4 +1,7 @@
 ---
+language:
+- en
+license: apache-2.0
 datasets:
 - Locutusque/TM-DATA-V2
 - LLM360/TxT360
@@ -6,9 +9,101 @@ datasets:
 - Skylion007/openwebtext
 - JeanKaddour/minipile
 - eminorhan/gutenberg_en
-language:
-- en
-license: apache-2.0
+model-index:
+- name: TinyMistral-248M-v3
+  results:
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: IFEval (0-Shot)
+      type: HuggingFaceH4/ifeval
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: inst_level_strict_acc and prompt_level_strict_acc
+      value: 16.39
+      name: strict accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=M4-ai/TinyMistral-248M-v3
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: BBH (3-Shot)
+      type: BBH
+      args:
+        num_few_shot: 3
+    metrics:
+    - type: acc_norm
+      value: 1.78
+      name: normalized accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=M4-ai/TinyMistral-248M-v3
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MATH Lvl 5 (4-Shot)
+      type: hendrycks/competition_math
+      args:
+        num_few_shot: 4
+    metrics:
+    - type: exact_match
+      value: 0.0
+      name: exact match
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=M4-ai/TinyMistral-248M-v3
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: GPQA (0-shot)
+      type: Idavidrein/gpqa
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: acc_norm
+      value: 0.0
+      name: acc_norm
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=M4-ai/TinyMistral-248M-v3
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MuSR (0-shot)
+      type: TAUR-Lab/MuSR
+      args:
+        num_few_shot: 0
+    metrics:
+    - type: acc_norm
+      value: 5.15
+      name: acc_norm
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=M4-ai/TinyMistral-248M-v3
+      name: Open LLM Leaderboard
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: MMLU-PRO (5-shot)
+      type: TIGER-Lab/MMLU-Pro
+      config: main
+      split: test
+      args:
+        num_few_shot: 5
+    metrics:
+    - type: acc
+      value: 1.47
+      name: accuracy
+    source:
+      url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=M4-ai/TinyMistral-248M-v3
+      name: Open LLM Leaderboard
 ---
 
 still in training. Trained on about ~21 billion tokens so far.
@@ -133,4 +228,17 @@ still in training. Trained on about ~21 billion tokens so far.
 
 |   Groups   |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
 |------------|------:|------|------|--------|---|-----:|---|-----:|
-|agieval_nous|      0|none  |      |acc_norm|↑  |0.2133|±  |0.0081|
+|agieval_nous|      0|none  |      |acc_norm|↑  |0.2133|±  |0.0081|
+# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
+Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_M4-ai__TinyMistral-248M-v3)
+
+|      Metric       |Value|
+|-------------------|----:|
+|Avg.               | 4.13|
+|IFEval (0-Shot)    |16.39|
+|BBH (3-Shot)       | 1.78|
+|MATH Lvl 5 (4-Shot)| 0.00|
+|GPQA (0-shot)      | 0.00|
+|MuSR (0-shot)      | 5.15|
+|MMLU-PRO (5-shot)  | 1.47|
+