Pankaj Mathur
commited on
Commit
•
435e21d
1
Parent(s):
99904e4
Update README.md
Browse files
README.md
CHANGED
@@ -22,10 +22,10 @@ Here are the results on metrics used by [HuggingFaceH4 Open LLM Leaderboard](htt
|
|
22 |
|:------:|:--------:|:-------:|:--------:|
|
23 |
|**Task**|**Metric**|**Value**|**Stderr**|
|
24 |
|*arc_challenge*|acc_norm|0.6314|0.0141|
|
25 |
-
|*hellaswag*|acc_norm
|
26 |
-
|*mmlu*|acc_norm
|
27 |
|*truthfulqa_mc*|mc2|0.5127|0.0157|
|
28 |
-
|**Total Average
|
29 |
|
30 |
|
31 |
## Example Usage
|
@@ -37,7 +37,7 @@ Here is the prompt format
|
|
37 |
You are an AI assistant that follows instruction extremely well. Help as much as you can.
|
38 |
|
39 |
### User:
|
40 |
-
|
41 |
|
42 |
### Assistant:
|
43 |
|
|
|
22 |
|:------:|:--------:|:-------:|:--------:|
|
23 |
|**Task**|**Metric**|**Value**|**Stderr**|
|
24 |
|*arc_challenge*|acc_norm|0.6314|0.0141|
|
25 |
+
|*hellaswag*|acc_norm|0.8242|0.0038|
|
26 |
+
|*mmlu*|acc_norm|0.5637|0.0351|
|
27 |
|*truthfulqa_mc*|mc2|0.5127|0.0157|
|
28 |
+
|**Total Average**|-|**0.6329877193**||
|
29 |
|
30 |
|
31 |
## Example Usage
|
|
|
37 |
You are an AI assistant that follows instruction extremely well. Help as much as you can.
|
38 |
|
39 |
### User:
|
40 |
+
Tell me about Orcas.
|
41 |
|
42 |
### Assistant:
|
43 |
|