zpn commited on
Commit
6e69bb6
1 Parent(s): e6083f6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -31,6 +31,7 @@ We have released several versions of our finetuned GPT-J model using [different
31
  - v1.0: The original model trained on the v1.0 dataset
32
  - v1.1-breezy: Trained on afiltered dataset where we removed all instances of AI language model
33
  - v1.2-jazzy: Trained on a filtered dataset where we also removed instances like I'm sorry, I can't answer... and AI language model
 
34
 
35
  To download a model with a specific revision run
36
 
@@ -68,6 +69,7 @@ Results on common sense reasoning benchmarks
68
  GPT4All-J 6.7B v1.0 73.4 74.8 63.4 64.7 54.9 36.0 40.2
69
  GPT4All-J v1.1-breezy 74.0 75.1 63.2 63.6 55.4 34.9 38.4
70
  GPT4All-J v1.2-jazzy *74.8* 74.9 63.6 63.8 56.6 35.3 41.0
 
71
  GPT4All-J Lora 6.7B 68.6 75.8 66.2 63.5 56.4 35.7 40.2
72
  GPT4All LLaMa Lora 7B 73.1 77.6 72.1 67.8 51.1 40.4 40.2
73
  Dolly 6B 68.8 77.3 67.6 63.9 62.9 38.7 41.2
 
31
  - v1.0: The original model trained on the v1.0 dataset
32
  - v1.1-breezy: Trained on afiltered dataset where we removed all instances of AI language model
33
  - v1.2-jazzy: Trained on a filtered dataset where we also removed instances like I'm sorry, I can't answer... and AI language model
34
+ - v1.3-groovy: We added Dolly and ShareGPT to the v1.2 dataset and removed ~8% of the dataset in v1.2 that contained semantic duplicates using [Atlas](https://atlas.nomic.ai/).
35
 
36
  To download a model with a specific revision run
37
 
 
69
  GPT4All-J 6.7B v1.0 73.4 74.8 63.4 64.7 54.9 36.0 40.2
70
  GPT4All-J v1.1-breezy 74.0 75.1 63.2 63.6 55.4 34.9 38.4
71
  GPT4All-J v1.2-jazzy *74.8* 74.9 63.6 63.8 56.6 35.3 41.0
72
+ GPT4All-J v1.3-groovy 73.6 74.3 63.8 63.5 57.7 35.0 38.8
73
  GPT4All-J Lora 6.7B 68.6 75.8 66.2 63.5 56.4 35.7 40.2
74
  GPT4All LLaMa Lora 7B 73.1 77.6 72.1 67.8 51.1 40.4 40.2
75
  Dolly 6B 68.8 77.3 67.6 63.9 62.9 38.7 41.2