fragata commited on
Commit
1f8f777
1 Parent(s): 8294734

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -14,10 +14,11 @@ widget:
14
 
15
  For further details, see [our demo site](https://juniper.nytud.hu/demo/puli).
16
 
17
- - Hungarian GPT-NeoX model (6,7 billion parameter)
18
  - Trained with EleutherAI's GPT-NeoX [github](https://github.com/EleutherAI/gpt-neox)
19
- - Dataset: 36,3 billion words
20
-
 
21
  ## Limitations
22
 
23
  - max_seq_length = 2048
 
14
 
15
  For further details, see [our demo site](https://juniper.nytud.hu/demo/puli).
16
 
17
+ - Hungarian GPT-NeoX model (6.7 billion parameter)
18
  - Trained with EleutherAI's GPT-NeoX [github](https://github.com/EleutherAI/gpt-neox)
19
+ - Dataset: 36.3 billion words
20
+ - Checkpoint: 150 000 step
21
+
22
  ## Limitations
23
 
24
  - max_seq_length = 2048