Wandb Run: https://wandb.ai/eleutherai/pythia-rlhf/runs/31gbxj2w

Eval Results:
|    Tasks     |Version|Filter|  Metric  |Value |   |Stderr|
|--------------|-------|------|----------|-----:|---|-----:|
|arc_challenge |Yaml   |none  |acc       |0.2159|±  |0.0120|
|              |       |none  |acc_norm  |0.2295|±  |0.0123|
|arc_easy      |Yaml   |none  |acc       |0.3266|±  |0.0096|
|              |       |none  |acc_norm  |0.3287|±  |0.0096|
|lambada_openai|Yaml   |none  |perplexity|   NaN|±  |   NaN|
|              |       |none  |acc       |0.1750|±  |0.0053|
|logiqa        |Yaml   |none  |acc       |0.2028|±  |0.0158|
|              |       |none  |acc_norm  |0.2028|±  |0.0158|
|piqa          |Yaml   |none  |acc       |0.5441|±  |0.0116|
|              |       |none  |acc_norm  |0.5446|±  |0.0116|
|sciq          |Yaml   |none  |acc       |0.2050|±  |0.0128|
|              |       |none  |acc_norm  |0.1940|±  |0.0125|
|winogrande    |Yaml   |none  |acc       |0.5043|±  |0.0141|
|wsc           |Yaml   |none  |acc       |0.6154|±  |0.0479|