Commit
·
df06437
1
Parent(s):
cb7aded
commit files to HF hub
Browse files
README.md
CHANGED
|
@@ -137,6 +137,23 @@ GPTNeoXConfig {
|
|
| 137 |
|
| 138 |
```
|
| 139 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 140 |
## Disclaimer
|
| 141 |
|
| 142 |
Please read this disclaimer carefully before using the large language model provided in this repository. Your use of the model signifies your agreement to the following terms and conditions.
|
|
|
|
| 137 |
|
| 138 |
```
|
| 139 |
|
| 140 |
+
|
| 141 |
+
| Task |Version| Metric |Value | |Stderr|
|
| 142 |
+
|-------------|------:|--------|-----:|---|-----:|
|
| 143 |
+
|hellaswag | 0|acc |0.5419|± |0.0050|
|
| 144 |
+
| | |acc_norm|0.7259|± |0.0045|
|
| 145 |
+
|boolq | 1|acc |0.7125|± |0.0079|
|
| 146 |
+
|piqa | 0|acc |0.7742|± |0.0098|
|
| 147 |
+
| | |acc_norm|0.7775|± |0.0097|
|
| 148 |
+
|openbookqa | 0|acc |0.2800|± |0.0201|
|
| 149 |
+
| | |acc_norm|0.4000|± |0.0219|
|
| 150 |
+
|arc_challenge| 0|acc |0.3993|± |0.0143|
|
| 151 |
+
| | |acc_norm|0.4420|± |0.0145|
|
| 152 |
+
|winogrande | 0|acc |0.6614|± |0.0133|
|
| 153 |
+
|arc_easy | 0|acc |0.7327|± |0.0091|
|
| 154 |
+
| | |acc_norm|0.6894|± |0.0095|
|
| 155 |
+
|
| 156 |
+
|
| 157 |
## Disclaimer
|
| 158 |
|
| 159 |
Please read this disclaimer carefully before using the large language model provided in this repository. Your use of the model signifies your agreement to the following terms and conditions.
|