luciferxf
/

gptxxxxxx

Text Generation

Inference Endpoints

Model card Files Files and versions Community

luciferxf commited on Mar 16, 2023

Commit

b3aabec

•

1 Parent(s): a07beee

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -13,7 +13,7 @@
   "n_embd": 768,
   "n_head": 12,
   "n_layer": 12,
-  "n_positions": 2560,
   "resid_pdrop": 0.1,
   "summary_activation": null,
   "summary_first_dropout": 0.1,

   "n_embd": 768,
   "n_head": 12,
   "n_layer": 12,
+  "n_positions": 2048,
   "resid_pdrop": 0.1,
   "summary_activation": null,
   "summary_first_dropout": 0.1,