Update README.md
Browse files
README.md
CHANGED
|
@@ -52,3 +52,16 @@ Bot (to Person): Hi, how are you?
|
|
| 52 |
```
|
| 53 |
|
| 54 |
This may not be the ideal template for this model without more training. Several of the models understand ChatML and Alpaca, and Instruct as well, so you can probably use whatever format you like. It will occasionally spit out some random code as well, but generally will be able to follow the conversation.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
```
|
| 53 |
|
| 54 |
This may not be the ideal template for this model without more training. Several of the models understand ChatML and Alpaca, and Instruct as well, so you can probably use whatever format you like. It will occasionally spit out some random code as well, but generally will be able to follow the conversation.
|
| 55 |
+
|
| 56 |
+
## Scores
|
| 57 |
+
|
| 58 |
+
Metric | Score
|
| 59 |
+
---|---
|
| 60 |
+
Average | 66.91
|
| 61 |
+
ARC | 65.19
|
| 62 |
+
HellaSwag | 85.36
|
| 63 |
+
MMLU | 65.2
|
| 64 |
+
TruthfulQA | 50.94
|
| 65 |
+
Winogrande | 80.35
|
| 66 |
+
GSM8K | 54.44
|
| 67 |
+
|