pankajmathur
/

model_007_preview

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Pankaj Mathur commited on Aug 25, 2023

Commit

e4297c8

·

1 Parent(s): 899b6ad

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -58,11 +58,11 @@ Here are the results on metrics used by [HuggingFaceH4 Open LLM Leaderboard](htt
 |||||
 |:------:|:--------:|:-------:|:--------:|
 |**Task**|**Metric**|**Value**|**Stderr**|
-|*arc_challenge*|acc_norm|0.6314|0.0141|
-|*hellaswag*|acc_norm|0.8242|0.0038|
-|*mmlu*|acc_norm|0.5637|0.0351|
-|*truthfulqa_mc*|mc2|0.5127|0.0157|
-|**Total Average**|-|**0.6329877193**||
 <br>

 |||||
 |:------:|:--------:|:-------:|:--------:|
 |**Task**|**Metric**|**Value**|**Stderr**|
+|*arc_challenge*|acc_norm|0.7142|0.0141|
+|*hellaswag*|acc_norm|0.8731|0.0038|
+|*mmlu*|acc_norm|0.6858|0.0351|
+|*truthfulqa_mc*|mc2|0.6265|0.0157|
+|**Total Average**|-|**0.7249**||
 <br>