SNT-700M / .ipynb_checkpoints /config-checkpoint.json
3v324v23's picture
Initial commit of GPT custom model
dcbdf8a
raw
history blame contribute delete
131 Bytes
{"vocab_size": 32000, "embed_size": 1500, "num_layers": 20, "heads": 20, "expansion_factor": 4, "dropout": 0.1, "max_length": 1024}