ilnikolaev commited on
Commit
53ac067
1 Parent(s): c11ef27

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -16,6 +16,7 @@ Trained from scratch using Tensorflow Keras
16
  - Type: decoder-only
17
  - Tokenizer: BPE
18
  - Vocabulary size: 32000
 
19
  - Hidden size: 768
20
  - FFN size: 3072
21
  - Attention heads: 24
 
16
  - Type: decoder-only
17
  - Tokenizer: BPE
18
  - Vocabulary size: 32000
19
+ - Max sequence length: 120
20
  - Hidden size: 768
21
  - FFN size: 3072
22
  - Attention heads: 24