Spaces:

flax-community
/

dalle-mini

Running

boris commited on Mar 25, 2022

Commit

d9a16f2

•

1 Parent(s): 472c4cc

feat: update mini config

Files changed (1) hide show

tools/train/config/mini/config.json CHANGED Viewed

@@ -5,12 +5,12 @@
   "bos_token_id": 16385,
   "d_model": 1024,
   "decoder_attention_heads": 16,
-  "decoder_ffn_dim": 2560,
   "decoder_layers": 12,
   "decoder_start_token_id": 16384,
   "dropout": 0.0,
   "encoder_attention_heads": 16,
-  "encoder_ffn_dim": 2560,
   "encoder_layers": 12,
   "encoder_vocab_size": 50264,
   "eos_token_id": 16385,

   "bos_token_id": 16385,
   "d_model": 1024,
   "decoder_attention_heads": 16,
+  "decoder_ffn_dim": 4096,
   "decoder_layers": 12,
   "decoder_start_token_id": 16384,
   "dropout": 0.0,
   "encoder_attention_heads": 16,
+  "encoder_ffn_dim": 4096,
   "encoder_layers": 12,
   "encoder_vocab_size": 50264,
   "eos_token_id": 16385,