Text Generation
Transformers
PyTorch
mosaic_gpt
custom_code
orm011 commited on
Commit
fc98636
·
1 Parent(s): 50d6bc9

Enable use of transformers.MPT model.

Browse files

Using that keyword there allows the open_flamingo factory to successfully return a model with the `trust_remote_code =False`.
The returned model is of type transformers.models.mpt.modeling_mpt.MptForCausalLM.
May be useful to other people.

Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -29,7 +29,7 @@
29
  "low_precision_layernorm": true,
30
  "max_seq_len": 2048,
31
  "mlp_ratio": 4,
32
- "model_type": "mosaic_gpt",
33
  "n_heads": 16,
34
  "n_layers": 24,
35
  "no_bias": true,
 
29
  "low_precision_layernorm": true,
30
  "max_seq_len": 2048,
31
  "mlp_ratio": 4,
32
+ "model_type": "mpt",
33
  "n_heads": 16,
34
  "n_layers": 24,
35
  "no_bias": true,