Update README.md
Browse files
README.md
CHANGED
@@ -14,10 +14,11 @@ widget:
|
|
14 |
|
15 |
For further details, see [our demo site](https://juniper.nytud.hu/demo/puli).
|
16 |
|
17 |
-
- Hungarian GPT-NeoX model (6
|
18 |
- Trained with EleutherAI's GPT-NeoX [github](https://github.com/EleutherAI/gpt-neox)
|
19 |
-
- Dataset: 36
|
20 |
-
|
|
|
21 |
## Limitations
|
22 |
|
23 |
- max_seq_length = 2048
|
|
|
14 |
|
15 |
For further details, see [our demo site](https://juniper.nytud.hu/demo/puli).
|
16 |
|
17 |
+
- Hungarian GPT-NeoX model (6.7 billion parameter)
|
18 |
- Trained with EleutherAI's GPT-NeoX [github](https://github.com/EleutherAI/gpt-neox)
|
19 |
+
- Dataset: 36.3 billion words
|
20 |
+
- Checkpoint: 150 000 step
|
21 |
+
|
22 |
## Limitations
|
23 |
|
24 |
- max_seq_length = 2048
|