yongzx
/

pythia-160m-sft-hh

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

usvsnsp commited on Aug 23, 2023

Commit

f7d8d88

·

1 Parent(s): 976a1d3

Add Lambada OpenAI to evals

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -13,4 +13,6 @@ Model Evals:
 |             |       |none  |acc_norm|0.6279|±  |0.0113|
 |sciq         |Yaml   |none  |acc     |0.7230|±  |0.0142|
 |             |       |none  |acc_norm|0.6840|±  |0.0147|
-|winogrande   |Yaml   |none  |acc     |0.5162|±  |0.0140|

 |             |       |none  |acc_norm|0.6279|±  |0.0113|
 |sciq         |Yaml   |none  |acc     |0.7230|±  |0.0142|
 |             |       |none  |acc_norm|0.6840|±  |0.0147|
+|winogrande   |Yaml   |none  |acc     |0.5162|±  |0.0140|
+|lambada_openai|Yaml   |none  |perplexity|58.9478|±  |2.7662|
+|              |       |none  |acc       | 0.2602|±  |0.0061|