jaspercatapang leaderboard-pr-bot commited on
Commit
07ed34d
1 Parent(s): cdd8a6c

Adding Evaluation Results (#2)

Browse files

- Adding Evaluation Results (b9faac07e9ded01d2968f0ce5724837c57da60e3)


Co-authored-by: Open LLM Leaderboard PR Bot <leaderboard-pr-bot@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -72,4 +72,17 @@ For additional information or inquiries about FinOPT-Washington, please contact
72
  FinOPT-Washington is an AI language model trained by Maya Philippines. It is provided "as is" without warranty of any kind, express or implied. The model developers and Maya Philippines shall not be liable for any direct or indirect damages arising from the use of this model.
73
 
74
  ## Acknowledgments
75
- The development of FinOPT-Washington was made possible by Maya Philippines and the curation and creation of the financial question-answering dataset.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
72
  FinOPT-Washington is an AI language model trained by Maya Philippines. It is provided "as is" without warranty of any kind, express or implied. The model developers and Maya Philippines shall not be liable for any direct or indirect damages arising from the use of this model.
73
 
74
  ## Acknowledgments
75
+ The development of FinOPT-Washington was made possible by Maya Philippines and the curation and creation of the financial question-answering dataset.
76
+ # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
77
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MayaPH__FinOPT-Washington)
78
+
79
+ | Metric | Value |
80
+ |-----------------------|---------------------------|
81
+ | Avg. | 24.87 |
82
+ | ARC (25-shot) | 25.17 |
83
+ | HellaSwag (10-shot) | 26.25 |
84
+ | MMLU (5-shot) | 24.83 |
85
+ | TruthfulQA (0-shot) | 45.8 |
86
+ | Winogrande (5-shot) | 51.07 |
87
+ | GSM8K (5-shot) | 0.0 |
88
+ | DROP (3-shot) | 1.0 |