YeungNLP
/

firefly-qwen-7b

Text Generation

Model card Files Files and versions Community

stphtan94117 commited on Sep 7, 2023

Commit

15653cf

·

1 Parent(s): 15dda9f

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -12,7 +12,7 @@
   "emb_dropout_prob": 0.0,
   "fp16": true,
   "fp32": false,
-  "hidden_size": 4096,
   "initializer_range": 0.02,
   "intermediate_size": 22016,
   "kv_channels": 128,

   "emb_dropout_prob": 0.0,
   "fp16": true,
   "fp32": false,
+  "hidden_size": 4296,
   "initializer_range": 0.02,
   "intermediate_size": 22016,
   "kv_channels": 128,