Aleph-Alpha
/

Pharia-1-Embedding-4608-control-hf

Safetensors

phariaembed

custom_code

Model card Files Files and versions Community

peralp24 commited on Dec 17, 2024

Commit

6f36275

verified ·

1 Parent(s): e1be73f

Update README.md

Browse files

Files changed (1) hide show

README.md +0 -4

README.md CHANGED Viewed

@@ -257,8 +257,6 @@ from [mteb/scripts/task_selection/europe_tasks.csv at main · embeddings-benchma
 | Model Name                                            |   AmazonCounterfactualClassification |   BUCC.v2 |   DiaBlaBitextMining |   MassiveScenarioClassification |   NTREXBitextMining |    STS17 |   Average |
 |-------------------------------------------------------|-------------------------------------:|----------:|---------------------:|--------------------------------:|--------------------:|---------:|----------:|
-| luminous-base-symmetric                               |                             0.710921 |  0.990569 |             0.85374  |                        0.710148 |            0.971263 | 0.879475 |  0.852686 |
-| Pharia-7b-2048-medi1-causal-weighted-adapter          |                             0.735118 |  0.984346 |             0.822481 |                        0.749375 |            0.968538 | 0.852473 |  0.852055 |
 | Pharia-1-Embedding-4608-control                       |                             0.724946 |  0.991884 |             0.865101 |                        0.755763 |            0.982374 | 0.876741 |  0.866135 |
 | GritLM-7B                                             |                             0.766381 |  0.994298 |             0.864504 |                        0.789334 |            0.984593 | 0.880716 |  0.879971 |
@@ -266,8 +264,6 @@ from [mteb/scripts/task_selection/europe_tasks.csv at main · embeddings-benchma
 | Model Name                                            |   deu-Latn |   eng-Latn |   fra-Latn |   por-Latn |   ita-Latn |   spa-Latn |   Average |
 |-------------------------------------------------------|-----------:|-----------:|-----------:|-----------:|-----------:|-----------:|----------:|
-| luminous-base-symmetric                               |   0.913887 |   0.90055  |   0.929288 |   0.927929 |   0.932836 |   0.93469  |  0.923197 |
-| Pharia-7b-2048-medi1-causal-weighted-adapter          |   0.914817 |   0.876927 |   0.918247 |   0.938783 |   0.92802  |   0.934084 |  0.91848  |
 | Pharia-1-Embedding-4608-control                       |   0.925309 |   0.902113 |   0.937961 |   0.953719 |   0.942352 |   0.945642 |  0.934516 |
 | GritLM-7B                                             |   0.934603 |   0.905669 |   0.942364 |   0.962042 |   0.949731 |   0.947428 |  0.940306 |

 | Model Name                                            |   AmazonCounterfactualClassification |   BUCC.v2 |   DiaBlaBitextMining |   MassiveScenarioClassification |   NTREXBitextMining |    STS17 |   Average |
 |-------------------------------------------------------|-------------------------------------:|----------:|---------------------:|--------------------------------:|--------------------:|---------:|----------:|
 | Pharia-1-Embedding-4608-control                       |                             0.724946 |  0.991884 |             0.865101 |                        0.755763 |            0.982374 | 0.876741 |  0.866135 |
 | GritLM-7B                                             |                             0.766381 |  0.994298 |             0.864504 |                        0.789334 |            0.984593 | 0.880716 |  0.879971 |
 | Model Name                                            |   deu-Latn |   eng-Latn |   fra-Latn |   por-Latn |   ita-Latn |   spa-Latn |   Average |
 |-------------------------------------------------------|-----------:|-----------:|-----------:|-----------:|-----------:|-----------:|----------:|
 | Pharia-1-Embedding-4608-control                       |   0.925309 |   0.902113 |   0.937961 |   0.953719 |   0.942352 |   0.945642 |  0.934516 |
 | GritLM-7B                                             |   0.934603 |   0.905669 |   0.942364 |   0.962042 |   0.949731 |   0.947428 |  0.940306 |