Text Generation
Transformers
PyTorch
English
gptj
srowen commited on
Commit
1f71c04
·
1 Parent(s): dff64dd

Fix table markdown

Browse files
Files changed (1) hide show
  1. README.md +1 -5
README.md CHANGED
@@ -190,16 +190,12 @@ above, but also point to an interesting observation. Namely, Dolly is only margi
190
  Despite this fact, the qualitative behavior of Dolly is materially different from the underlying model ([try it yourself](https://huggingface.co/EleutherAI/gpt-j-6B) on Hugging Face!),
191
  which points to meaningful limitations of the existing evaluation benchmarks for measuring the quality of generative models.
192
 
193
- ```
194
- +-----------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+
195
  | model | openbookqa | arc_easy | winogrande | hellaswag | arc_challenge | piqa | boolq |
196
- +-----------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------|
197
  | cerebras/Cerebras-GPT-13B | 0.36 | 0.598906 | 0.607735 | 0.593109 | 0.325939 | 0.749728 | 0.611621 |
198
  | EleutherAI/gpt-j-6B | 0.382 | 0.621633 | 0.651144 | 0.662617 | 0.363481 | 0.761153 | 0.655963 |
199
  | dolly-v1-6b (1 epoch) | 0.428 | 0.608586 | 0.633781 | 0.650568 | 0.377133 | 0.761697 | 0.69633 |
200
  | dolly-v1-6b (10 epochs) | 0.41 | 0.62963 | 0.643252 | 0.676758 | 0.384812 | 0.773667 | 0.687768 |
201
  | EleutherAI/gpt-neox-20b | 0.402 | 0.683923 | 0.656669 | 0.7142 | 0.408703 | 0.784004 | 0.695413 |
202
- +-----------------------------+--------------+------------+--------------+-------------+-----------------+----------+----------+
203
- ```
204
 
205
  # Happy Hacking!
 
190
  Despite this fact, the qualitative behavior of Dolly is materially different from the underlying model ([try it yourself](https://huggingface.co/EleutherAI/gpt-j-6B) on Hugging Face!),
191
  which points to meaningful limitations of the existing evaluation benchmarks for measuring the quality of generative models.
192
 
 
 
193
  | model | openbookqa | arc_easy | winogrande | hellaswag | arc_challenge | piqa | boolq |
194
+ | --------------------------- | ------------ | ---------- | ------------ | ----------- | --------------- | -------- | ---------|
195
  | cerebras/Cerebras-GPT-13B | 0.36 | 0.598906 | 0.607735 | 0.593109 | 0.325939 | 0.749728 | 0.611621 |
196
  | EleutherAI/gpt-j-6B | 0.382 | 0.621633 | 0.651144 | 0.662617 | 0.363481 | 0.761153 | 0.655963 |
197
  | dolly-v1-6b (1 epoch) | 0.428 | 0.608586 | 0.633781 | 0.650568 | 0.377133 | 0.761697 | 0.69633 |
198
  | dolly-v1-6b (10 epochs) | 0.41 | 0.62963 | 0.643252 | 0.676758 | 0.384812 | 0.773667 | 0.687768 |
199
  | EleutherAI/gpt-neox-20b | 0.402 | 0.683923 | 0.656669 | 0.7142 | 0.408703 | 0.784004 | 0.695413 |
 
 
200
 
201
  # Happy Hacking!