Dampish
/

StellarX-4B-V0

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Dampish commited on May 28, 2023

Commit

5a9360f

•

1 Parent(s): 3c09c86

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -14,7 +14,7 @@
   "max_position_embeddings": 2048,
   "model_type": "gpt_neox",
   "num_attention_heads": 32,
-  "num_hidden_layers": 46,
   "rotary_emb_base": 10000,
   "rotary_pct": 1.0,
   "tie_word_embeddings": false,

   "max_position_embeddings": 2048,
   "model_type": "gpt_neox",
   "num_attention_heads": 32,
+  "num_hidden_layers": 47,
   "rotary_emb_base": 10000,
   "rotary_pct": 1.0,
   "tie_word_embeddings": false,