Aleph-Alpha
/

Pharia-1-Embedding-4608-control-hf

Model card Files Files and versions Community

peralp24 commited on 4 days ago

Commit

d20c48a

•

1 Parent(s): 22a8cfd

Update modeling_pharia.py

Files changed (1) hide show

modeling_pharia.py +2 -2

modeling_pharia.py CHANGED Viewed

@@ -77,8 +77,8 @@ class PhariaConfig(PretrainedConfig):
         initializer_range=0.02,
         intermediate_size=2048,
         max_position_embeddings=8192,
-        #model_type="pharia-v2",
-        model_type="phariaembed",
         num_attention_heads=4,
         num_hidden_layers=4,
         num_key_value_heads=2,

         initializer_range=0.02,
         intermediate_size=2048,
         max_position_embeddings=8192,
+        model_type="pharia-v2",
+        #model_type="phariaembed",
         num_attention_heads=4,
         num_hidden_layers=4,
         num_key_value_heads=2,