test / config.json
YvanCarre's picture
Update config.json
fdef007 verified
raw
history blame
180 Bytes
{
"bias": false,
"architectures": [
"GPT2LMHeadModel"
],
"block_size": 1024,
"dropout": 0.0,
"n_embd": 768,
"n_head": 12,
"n_layer": 12,
"vocab_size": 32001
}