Your Name commited on
Commit
dcbdf8a
1 Parent(s): 25fd532

Initial commit of GPT custom model

Browse files
.ipynb_checkpoints/config-checkpoint.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"vocab_size": 32000, "embed_size": 1500, "num_layers": 20, "heads": 20, "expansion_factor": 4, "dropout": 0.1, "max_length": 1024}