Hugging Face's logo

Spaces:
TIGER-Lab
/
MMEB
Running

App Files Community
29
MINGYISU commited on
Commit
1adec3d
·
1 Parent(s): 30c0fb9

update results

Browse files
Files changed (2) hide show
  1. results.csv +2 -1
  2. utils.py +1 -0
results.csv CHANGED
@@ -13,4 +13,5 @@ VLM2Vec (Phi-3.5-V-FT),4.15,TIGER-Lab,55.9,52.8,50.3,57.8,72.3
13
  VLM2Vec (Phi-3.5-V-LoRA),4.15,TIGER-Lab,60.1,54.8,54.9,62.3,79.5
14
  VLM2Vec (LLaVA-1.6-LoRA-LowRes),7.57,TIGER-Lab,55.0,54.7,50.3,56.2,64.0
15
  VLM2Vec (LLaVA-1.6-LoRA-HighRes),7.57,TIGER-Lab,62.9,61.2,49.9,67.4,86.1
16
- MMRet-large,0.428,Self-Reported,64.1,56.0,57.4,69.9,83.6
 
 
13
  VLM2Vec (Phi-3.5-V-LoRA),4.15,TIGER-Lab,60.1,54.8,54.9,62.3,79.5
14
  VLM2Vec (LLaVA-1.6-LoRA-LowRes),7.57,TIGER-Lab,55.0,54.7,50.3,56.2,64.0
15
  VLM2Vec (LLaVA-1.6-LoRA-HighRes),7.57,TIGER-Lab,62.9,61.2,49.9,67.4,86.1
16
+ MMRet-large,0.428,Self-Reported,64.1,56.0,57.4,69.9,83.6
17
+ mmE5-mllama-11b-instruct,10.6,Self-Reported,69.8,67.6,62.6,71.0,89.6
utils.py CHANGED
@@ -110,6 +110,7 @@ MODEL_URLS = {
110
  "UniIR": "https://huggingface.co/TIGER-Lab/UniIR",
111
  "OpenCLIP-FT": "https://doi.org/10.48550/arXiv.2212.07143",
112
  "CLIP-FT": "https://doi.org/10.48550/arXiv.2103.00020"
 
113
  }
114
 
115
  def create_hyperlinked_names(df):
 
110
  "UniIR": "https://huggingface.co/TIGER-Lab/UniIR",
111
  "OpenCLIP-FT": "https://doi.org/10.48550/arXiv.2212.07143",
112
  "CLIP-FT": "https://doi.org/10.48550/arXiv.2103.00020"
113
+ "mmE5-mllama-11b-instruct": "https://huggingface.co/intfloat/mmE5-mllama-11b-instruct"
114
  }
115
 
116
  def create_hyperlinked_names(df):