yongzx
/

pythia-70m-sft-hh

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

usvsnsp commited on Aug 23, 2023

Commit

fbf81ef

•

1 Parent(s): 3df871a

Add Lambada OpenAI to evals

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -14,4 +14,6 @@ Evaluation results:
 |             |       |none  |acc_norm|0.5941|±  |0.0115|
 |sciq         |Yaml   |none  |acc     |0.5930|±  |0.0155|
 |             |       |none  |acc_norm|0.5720|±  |0.0157|
-|winogrande   |Yaml   |none  |acc     |0.5154|±  |0.0140|

 |             |       |none  |acc_norm|0.5941|±  |0.0115|
 |sciq         |Yaml   |none  |acc     |0.5930|±  |0.0155|
 |             |       |none  |acc_norm|0.5720|±  |0.0157|
+|winogrande   |Yaml   |none  |acc     |0.5154|±  |0.0140|
+|lambada_openai|Yaml   |none  |perplexity|730.2552|±  |46.8739|
+|              |       |none  |acc       |  0.1316|±  | 0.0047|