Fix table markdown
Browse files
README.md
CHANGED
@@ -190,16 +190,12 @@ above, but also point to an interesting observation. Namely, Dolly is only margi
|
|
190 |
Despite this fact, the qualitative behavior of Dolly is materially different from the underlying model ([try it yourself](https://huggingface.co/EleutherAI/gpt-j-6B) on Hugging Face!),
|
191 |
which points to meaningful limitations of the existing evaluation benchmarks for measuring the quality of generative models.
|
192 |
|
193 |
-
```
|
194 |
-
+-----------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+
|
195 |
| model | openbookqa | arc_easy | winogrande | hellaswag | arc_challenge | piqa | boolq |
|
196 |
-
|
197 |
| cerebras/Cerebras-GPT-13B | 0.36 | 0.598906 | 0.607735 | 0.593109 | 0.325939 | 0.749728 | 0.611621 |
|
198 |
| EleutherAI/gpt-j-6B | 0.382 | 0.621633 | 0.651144 | 0.662617 | 0.363481 | 0.761153 | 0.655963 |
|
199 |
| dolly-v1-6b (1 epoch) | 0.428 | 0.608586 | 0.633781 | 0.650568 | 0.377133 | 0.761697 | 0.69633 |
|
200 |
| dolly-v1-6b (10 epochs) | 0.41 | 0.62963 | 0.643252 | 0.676758 | 0.384812 | 0.773667 | 0.687768 |
|
201 |
| EleutherAI/gpt-neox-20b | 0.402 | 0.683923 | 0.656669 | 0.7142 | 0.408703 | 0.784004 | 0.695413 |
|
202 |
-
+-----------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+
|
203 |
-
```
|
204 |
|
205 |
# Happy Hacking!
|
|
|
190 |
Despite this fact, the qualitative behavior of Dolly is materially different from the underlying model ([try it yourself](https://huggingface.co/EleutherAI/gpt-j-6B) on Hugging Face!),
|
191 |
which points to meaningful limitations of the existing evaluation benchmarks for measuring the quality of generative models.
|
192 |
|
|
|
|
|
193 |
| model | openbookqa | arc_easy | winogrande | hellaswag | arc_challenge | piqa | boolq |
|
194 |
+
| --------------------------- | ------------ | ---------- | ------------ | ----------- | --------------- | -------- | ---------|
|
195 |
| cerebras/Cerebras-GPT-13B | 0.36 | 0.598906 | 0.607735 | 0.593109 | 0.325939 | 0.749728 | 0.611621 |
|
196 |
| EleutherAI/gpt-j-6B | 0.382 | 0.621633 | 0.651144 | 0.662617 | 0.363481 | 0.761153 | 0.655963 |
|
197 |
| dolly-v1-6b (1 epoch) | 0.428 | 0.608586 | 0.633781 | 0.650568 | 0.377133 | 0.761697 | 0.69633 |
|
198 |
| dolly-v1-6b (10 epochs) | 0.41 | 0.62963 | 0.643252 | 0.676758 | 0.384812 | 0.773667 | 0.687768 |
|
199 |
| EleutherAI/gpt-neox-20b | 0.402 | 0.683923 | 0.656669 | 0.7142 | 0.408703 | 0.784004 | 0.695413 |
|
|
|
|
|
200 |
|
201 |
# Happy Hacking!
|