Update README.md
Browse files
README.md
CHANGED
@@ -31,6 +31,7 @@ We have released several versions of our finetuned GPT-J model using [different
|
|
31 |
- v1.0: The original model trained on the v1.0 dataset
|
32 |
- v1.1-breezy: Trained on afiltered dataset where we removed all instances of AI language model
|
33 |
- v1.2-jazzy: Trained on a filtered dataset where we also removed instances like I'm sorry, I can't answer... and AI language model
|
|
|
34 |
|
35 |
To download a model with a specific revision run
|
36 |
|
@@ -68,6 +69,7 @@ Results on common sense reasoning benchmarks
|
|
68 |
GPT4All-J 6.7B v1.0 73.4 74.8 63.4 64.7 54.9 36.0 40.2
|
69 |
GPT4All-J v1.1-breezy 74.0 75.1 63.2 63.6 55.4 34.9 38.4
|
70 |
GPT4All-J v1.2-jazzy *74.8* 74.9 63.6 63.8 56.6 35.3 41.0
|
|
|
71 |
GPT4All-J Lora 6.7B 68.6 75.8 66.2 63.5 56.4 35.7 40.2
|
72 |
GPT4All LLaMa Lora 7B 73.1 77.6 72.1 67.8 51.1 40.4 40.2
|
73 |
Dolly 6B 68.8 77.3 67.6 63.9 62.9 38.7 41.2
|
|
|
31 |
- v1.0: The original model trained on the v1.0 dataset
|
32 |
- v1.1-breezy: Trained on afiltered dataset where we removed all instances of AI language model
|
33 |
- v1.2-jazzy: Trained on a filtered dataset where we also removed instances like I'm sorry, I can't answer... and AI language model
|
34 |
+
- v1.3-groovy: We added Dolly and ShareGPT to the v1.2 dataset and removed ~8% of the dataset in v1.2 that contained semantic duplicates using [Atlas](https://atlas.nomic.ai/).
|
35 |
|
36 |
To download a model with a specific revision run
|
37 |
|
|
|
69 |
GPT4All-J 6.7B v1.0 73.4 74.8 63.4 64.7 54.9 36.0 40.2
|
70 |
GPT4All-J v1.1-breezy 74.0 75.1 63.2 63.6 55.4 34.9 38.4
|
71 |
GPT4All-J v1.2-jazzy *74.8* 74.9 63.6 63.8 56.6 35.3 41.0
|
72 |
+
GPT4All-J v1.3-groovy 73.6 74.3 63.8 63.5 57.7 35.0 38.8
|
73 |
GPT4All-J Lora 6.7B 68.6 75.8 66.2 63.5 56.4 35.7 40.2
|
74 |
GPT4All LLaMa Lora 7B 73.1 77.6 72.1 67.8 51.1 40.4 40.2
|
75 |
Dolly 6B 68.8 77.3 67.6 63.9 62.9 38.7 41.2
|