merge
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the MOE merge method.
Models Merged
The following models were included in the merge:
- Jacoby746/Proto-Harpy-Avian-v0.1-7B
- Jacoby746/Proto-Harpy-Burst-v0.1-7B
- Jacoby746/Proto-Harpy-Spark-v0.1-7B
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 22.29 |
| IFEval (0-Shot) | 49.05 |
| BBH (3-Shot) | 32.63 |
| MATH Lvl 5 (4-Shot) | 6.34 |
| GPQA (0-shot) | 6.04 |
| MuSR (0-shot) | 14.12 |
| MMLU-PRO (5-shot) | 25.57 |
- Downloads last month
- 0
Model tree for Jacoby746/Proto-Harpy-Blazing-Light-v0.1-2x7B
Merge model
this model
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard49.050
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard32.630
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard6.340
- acc_norm on GPQA (0-shot)Open LLM Leaderboard6.040
- acc_norm on MuSR (0-shot)Open LLM Leaderboard14.120
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard25.570