reach-vb HF staff commited on
Commit
f033992
1 Parent(s): 4970fe9

Rename params.json to config.json (#7)

Browse files

- Rename params.json to config.json (2fc78471c680e1ec8e4023a07fa598ee3171b1f4)

Files changed (1) hide show
  1. params.json → config.json +1 -1
params.json → config.json RENAMED
@@ -1 +1 @@
1
- {"dim": 4096, "n_layers": 32, "head_dim": 128, "hidden_dim": 14336, "n_heads": 32, "n_kv_heads": 8, "norm_eps": 1e-05, "vocab_size": 32000, "moe": {"num_experts_per_tok": 2, "num_experts": 8}}
 
1
+ {"dim": 4096, "n_layers": 32, "head_dim": 128, "hidden_dim": 14336, "n_heads": 32, "n_kv_heads": 8, "norm_eps": 1e-05, "vocab_size": 32000, "moe": {"num_experts_per_tok": 2, "num_experts": 8}, "model_type": "mixtral"}