Update README.md
Browse files
README.md
CHANGED
@@ -12,18 +12,6 @@ Stable-Platypus-13B is a merge of [`garage-bAInd/Platypus2-13B`](https://hugging
|
|
12 |
|
13 |
![Platty](./Best_Platty_small.jpeg)
|
14 |
|
15 |
-
### Benchmark Metrics
|
16 |
-
|
17 |
-
| Metric | Value |
|
18 |
-
|-----------------------|-------|
|
19 |
-
| MMLU (5-shot) | 58.30 |
|
20 |
-
| ARC (25-shot) | 62.71 |
|
21 |
-
| HellaSwag (10-shot) | 82.29 |
|
22 |
-
| TruthfulQA (0-shot) | 52.52 |
|
23 |
-
| Avg. | 63.96 |
|
24 |
-
|
25 |
-
We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
|
26 |
-
|
27 |
### Model Details
|
28 |
|
29 |
* **Trained by**: **Platypus2-13B** trained by Cole Hunter & Ariel Lee; **StableBeluga-13B** trained by StabilityAI
|
|
|
12 |
|
13 |
![Platty](./Best_Platty_small.jpeg)
|
14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
### Model Details
|
16 |
|
17 |
* **Trained by**: **Platypus2-13B** trained by Cole Hunter & Ariel Lee; **StableBeluga-13B** trained by StabilityAI
|