lvkaokao commited on
Commit
ef0a5f3
1 Parent(s): 284cbf2
Files changed (1) hide show
  1. README.md +2869 -3
README.md CHANGED
@@ -1,3 +1,2869 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - mteb
4
+ model-index:
5
+ - name: neural-embedding-v1
6
+ results:
7
+ - task:
8
+ type: Classification
9
+ dataset:
10
+ type: mteb/amazon_counterfactual
11
+ name: MTEB AmazonCounterfactualClassification (en)
12
+ config: en
13
+ split: test
14
+ revision: e8379541af4e31359cca9fbcf4b00f2671dba205
15
+ metrics:
16
+ - type: accuracy
17
+ value: 93.10447761194031
18
+ - type: ap
19
+ value: 72.52673607512206
20
+ - type: f1
21
+ value: 89.6752355529259
22
+ - task:
23
+ type: Classification
24
+ dataset:
25
+ type: mteb/amazon_polarity
26
+ name: MTEB AmazonPolarityClassification
27
+ config: default
28
+ split: test
29
+ revision: e2d317d38cd51312af73b3d32a06d1a08b442046
30
+ metrics:
31
+ - type: accuracy
32
+ value: 97.536525
33
+ - type: ap
34
+ value: 96.46802431780014
35
+ - type: f1
36
+ value: 97.53623627430422
37
+ - task:
38
+ type: Classification
39
+ dataset:
40
+ type: mteb/amazon_reviews_multi
41
+ name: MTEB AmazonReviewsClassification (en)
42
+ config: en
43
+ split: test
44
+ revision: 1399c76144fd37290681b995c656ef9b2e06e26d
45
+ metrics:
46
+ - type: accuracy
47
+ value: 61.17399999999999
48
+ - type: f1
49
+ value: 60.40485236445537
50
+ - task:
51
+ type: Retrieval
52
+ dataset:
53
+ type: mteb/arguana
54
+ name: MTEB ArguAna
55
+ config: default
56
+ split: test
57
+ revision: c22ab2a51041ffd869aaddef7af8d8215647e41a
58
+ metrics:
59
+ - type: map_at_1
60
+ value: 44.452000000000005
61
+ - type: map_at_10
62
+ value: 59.563
63
+ - type: map_at_100
64
+ value: 60.014
65
+ - type: map_at_1000
66
+ value: 60.016000000000005
67
+ - type: map_at_20
68
+ value: 59.923
69
+ - type: map_at_3
70
+ value: 55.915000000000006
71
+ - type: map_at_5
72
+ value: 58.056
73
+ - type: mrr_at_1
74
+ value: 45.804
75
+ - type: mrr_at_10
76
+ value: 60.089999999999996
77
+ - type: mrr_at_100
78
+ value: 60.541
79
+ - type: mrr_at_1000
80
+ value: 60.543
81
+ - type: mrr_at_20
82
+ value: 60.45
83
+ - type: mrr_at_3
84
+ value: 56.294
85
+ - type: mrr_at_5
86
+ value: 58.54899999999999
87
+ - type: ndcg_at_1
88
+ value: 44.452000000000005
89
+ - type: ndcg_at_10
90
+ value: 67.208
91
+ - type: ndcg_at_100
92
+ value: 69.074
93
+ - type: ndcg_at_1000
94
+ value: 69.122
95
+ - type: ndcg_at_20
96
+ value: 68.474
97
+ - type: ndcg_at_3
98
+ value: 59.758
99
+ - type: ndcg_at_5
100
+ value: 63.621
101
+ - type: precision_at_1
102
+ value: 44.452000000000005
103
+ - type: precision_at_10
104
+ value: 9.125
105
+ - type: precision_at_100
106
+ value: 0.993
107
+ - type: precision_at_1000
108
+ value: 0.1
109
+ - type: precision_at_20
110
+ value: 4.808
111
+ - type: precision_at_3
112
+ value: 23.637
113
+ - type: precision_at_5
114
+ value: 16.06
115
+ - type: recall_at_1
116
+ value: 44.452000000000005
117
+ - type: recall_at_10
118
+ value: 91.252
119
+ - type: recall_at_100
120
+ value: 99.289
121
+ - type: recall_at_1000
122
+ value: 99.644
123
+ - type: recall_at_20
124
+ value: 96.15899999999999
125
+ - type: recall_at_3
126
+ value: 70.91
127
+ - type: recall_at_5
128
+ value: 80.29899999999999
129
+ - task:
130
+ type: Clustering
131
+ dataset:
132
+ type: mteb/arxiv-clustering-p2p
133
+ name: MTEB ArxivClusteringP2P
134
+ config: default
135
+ split: test
136
+ revision: a122ad7f3f0291bf49cc6f4d32aa80929df69d5d
137
+ metrics:
138
+ - type: v_measure
139
+ value: 53.445166004781356
140
+ - task:
141
+ type: Clustering
142
+ dataset:
143
+ type: mteb/arxiv-clustering-s2s
144
+ name: MTEB ArxivClusteringS2S
145
+ config: default
146
+ split: test
147
+ revision: f910caf1a6075f7329cdf8c1a6135696f37dbd53
148
+ metrics:
149
+ - type: v_measure
150
+ value: 48.82101672589653
151
+ - task:
152
+ type: Reranking
153
+ dataset:
154
+ type: mteb/askubuntudupquestions-reranking
155
+ name: MTEB AskUbuntuDupQuestions
156
+ config: default
157
+ split: test
158
+ revision: 2000358ca161889fa9c082cb41daa8dcfb161a54
159
+ metrics:
160
+ - type: map
161
+ value: 68.44973588765177
162
+ - type: mrr
163
+ value: 80.355274150288
164
+ - task:
165
+ type: STS
166
+ dataset:
167
+ type: mteb/biosses-sts
168
+ name: MTEB BIOSSES
169
+ config: default
170
+ split: test
171
+ revision: d3fb88f8f02e40887cd149695127462bbcf29b4a
172
+ metrics:
173
+ - type: cos_sim_pearson
174
+ value: 90.06690068909613
175
+ - type: cos_sim_spearman
176
+ value: 87.97730582741434
177
+ - type: euclidean_pearson
178
+ value: 86.04185393610108
179
+ - type: euclidean_spearman
180
+ value: 85.91340337831018
181
+ - type: manhattan_pearson
182
+ value: 86.05913485565931
183
+ - type: manhattan_spearman
184
+ value: 85.70195277713228
185
+ - task:
186
+ type: Classification
187
+ dataset:
188
+ type: mteb/banking77
189
+ name: MTEB Banking77Classification
190
+ config: default
191
+ split: test
192
+ revision: 0fd18e25b25c072e09e0d92ab615fda904d66300
193
+ metrics:
194
+ - type: accuracy
195
+ value: 88.73376623376623
196
+ - type: f1
197
+ value: 88.67733851784945
198
+ - task:
199
+ type: Clustering
200
+ dataset:
201
+ type: mteb/biorxiv-clustering-p2p
202
+ name: MTEB BiorxivClusteringP2P
203
+ config: default
204
+ split: test
205
+ revision: 65b79d1d13f80053f67aca9498d9402c2d9f1f40
206
+ metrics:
207
+ - type: v_measure
208
+ value: 48.822459956481474
209
+ - task:
210
+ type: Clustering
211
+ dataset:
212
+ type: mteb/biorxiv-clustering-s2s
213
+ name: MTEB BiorxivClusteringS2S
214
+ config: default
215
+ split: test
216
+ revision: 258694dd0231531bc1fd9de6ceb52a0853c6d908
217
+ metrics:
218
+ - type: v_measure
219
+ value: 45.068617486695764
220
+ - task:
221
+ type: Retrieval
222
+ dataset:
223
+ type: mteb/cqadupstack-android
224
+ name: MTEB CQADupstackAndroidRetrieval
225
+ config: default
226
+ split: test
227
+ revision: f46a197baaae43b4f621051089b82a364682dfeb
228
+ metrics:
229
+ - type: map_at_1
230
+ value: 36.980000000000004
231
+ - type: map_at_10
232
+ value: 51.151
233
+ - type: map_at_100
234
+ value: 52.852
235
+ - type: map_at_1000
236
+ value: 52.957
237
+ - type: map_at_20
238
+ value: 52.196
239
+ - type: map_at_3
240
+ value: 46.537
241
+ - type: map_at_5
242
+ value: 49.025999999999996
243
+ - type: mrr_at_1
244
+ value: 45.494
245
+ - type: mrr_at_10
246
+ value: 56.765
247
+ - type: mrr_at_100
248
+ value: 57.483
249
+ - type: mrr_at_1000
250
+ value: 57.508
251
+ - type: mrr_at_20
252
+ value: 57.255
253
+ - type: mrr_at_3
254
+ value: 53.815000000000005
255
+ - type: mrr_at_5
256
+ value: 55.725
257
+ - type: ndcg_at_1
258
+ value: 45.494
259
+ - type: ndcg_at_10
260
+ value: 58.435
261
+ - type: ndcg_at_100
262
+ value: 63.318
263
+ - type: ndcg_at_1000
264
+ value: 64.498
265
+ - type: ndcg_at_20
266
+ value: 60.88
267
+ - type: ndcg_at_3
268
+ value: 52.307
269
+ - type: ndcg_at_5
270
+ value: 55.103
271
+ - type: precision_at_1
272
+ value: 45.494
273
+ - type: precision_at_10
274
+ value: 11.488
275
+ - type: precision_at_100
276
+ value: 1.735
277
+ - type: precision_at_1000
278
+ value: 0.215
279
+ - type: precision_at_20
280
+ value: 6.8309999999999995
281
+ - type: precision_at_3
282
+ value: 25.513
283
+ - type: precision_at_5
284
+ value: 18.282999999999998
285
+ - type: recall_at_1
286
+ value: 36.980000000000004
287
+ - type: recall_at_10
288
+ value: 72.82300000000001
289
+ - type: recall_at_100
290
+ value: 91.525
291
+ - type: recall_at_1000
292
+ value: 98.44800000000001
293
+ - type: recall_at_20
294
+ value: 81.345
295
+ - type: recall_at_3
296
+ value: 55.044000000000004
297
+ - type: recall_at_5
298
+ value: 63.441
299
+ - task:
300
+ type: Retrieval
301
+ dataset:
302
+ type: mteb/cqadupstack-english
303
+ name: MTEB CQADupstackEnglishRetrieval
304
+ config: default
305
+ split: test
306
+ revision: ad9991cb51e31e31e430383c75ffb2885547b5f0
307
+ metrics:
308
+ - type: map_at_1
309
+ value: 37.489
310
+ - type: map_at_10
311
+ value: 50.708
312
+ - type: map_at_100
313
+ value: 52.101
314
+ - type: map_at_1000
315
+ value: 52.22
316
+ - type: map_at_20
317
+ value: 51.514
318
+ - type: map_at_3
319
+ value: 46.915
320
+ - type: map_at_5
321
+ value: 49.185
322
+ - type: mrr_at_1
323
+ value: 47.643
324
+ - type: mrr_at_10
325
+ value: 56.806
326
+ - type: mrr_at_100
327
+ value: 57.369
328
+ - type: mrr_at_1000
329
+ value: 57.399
330
+ - type: mrr_at_20
331
+ value: 57.141
332
+ - type: mrr_at_3
333
+ value: 54.437000000000005
334
+ - type: mrr_at_5
335
+ value: 55.955999999999996
336
+ - type: ndcg_at_1
337
+ value: 47.643
338
+ - type: ndcg_at_10
339
+ value: 56.989000000000004
340
+ - type: ndcg_at_100
341
+ value: 60.995999999999995
342
+ - type: ndcg_at_1000
343
+ value: 62.668
344
+ - type: ndcg_at_20
345
+ value: 58.63699999999999
346
+ - type: ndcg_at_3
347
+ value: 52.26499999999999
348
+ - type: ndcg_at_5
349
+ value: 54.684999999999995
350
+ - type: precision_at_1
351
+ value: 47.643
352
+ - type: precision_at_10
353
+ value: 10.879
354
+ - type: precision_at_100
355
+ value: 1.6320000000000001
356
+ - type: precision_at_1000
357
+ value: 0.211
358
+ - type: precision_at_20
359
+ value: 6.338000000000001
360
+ - type: precision_at_3
361
+ value: 25.52
362
+ - type: precision_at_5
363
+ value: 18.229
364
+ - type: recall_at_1
365
+ value: 37.489
366
+ - type: recall_at_10
367
+ value: 68.10300000000001
368
+ - type: recall_at_100
369
+ value: 84.497
370
+ - type: recall_at_1000
371
+ value: 94.402
372
+ - type: recall_at_20
373
+ value: 73.849
374
+ - type: recall_at_3
375
+ value: 53.925
376
+ - type: recall_at_5
377
+ value: 60.878
378
+ - task:
379
+ type: Retrieval
380
+ dataset:
381
+ type: mteb/cqadupstack-gaming
382
+ name: MTEB CQADupstackGamingRetrieval
383
+ config: default
384
+ split: test
385
+ revision: 4885aa143210c98657558c04aaf3dc47cfb54340
386
+ metrics:
387
+ - type: map_at_1
388
+ value: 45.044000000000004
389
+ - type: map_at_10
390
+ value: 59.804
391
+ - type: map_at_100
392
+ value: 60.841
393
+ - type: map_at_1000
394
+ value: 60.870999999999995
395
+ - type: map_at_20
396
+ value: 60.478
397
+ - type: map_at_3
398
+ value: 56.169000000000004
399
+ - type: map_at_5
400
+ value: 58.331999999999994
401
+ - type: mrr_at_1
402
+ value: 51.849999999999994
403
+ - type: mrr_at_10
404
+ value: 63.249
405
+ - type: mrr_at_100
406
+ value: 63.786
407
+ - type: mrr_at_1000
408
+ value: 63.797000000000004
409
+ - type: mrr_at_20
410
+ value: 63.592999999999996
411
+ - type: mrr_at_3
412
+ value: 60.721000000000004
413
+ - type: mrr_at_5
414
+ value: 62.251
415
+ - type: ndcg_at_1
416
+ value: 51.849999999999994
417
+ - type: ndcg_at_10
418
+ value: 66.122
419
+ - type: ndcg_at_100
420
+ value: 69.614
421
+ - type: ndcg_at_1000
422
+ value: 70.12
423
+ - type: ndcg_at_20
424
+ value: 67.805
425
+ - type: ndcg_at_3
426
+ value: 60.348
427
+ - type: ndcg_at_5
428
+ value: 63.33800000000001
429
+ - type: precision_at_1
430
+ value: 51.849999999999994
431
+ - type: precision_at_10
432
+ value: 10.539
433
+ - type: precision_at_100
434
+ value: 1.327
435
+ - type: precision_at_1000
436
+ value: 0.13999999999999999
437
+ - type: precision_at_20
438
+ value: 5.865
439
+ - type: precision_at_3
440
+ value: 27.084999999999997
441
+ - type: precision_at_5
442
+ value: 18.483
443
+ - type: recall_at_1
444
+ value: 45.044000000000004
445
+ - type: recall_at_10
446
+ value: 81.192
447
+ - type: recall_at_100
448
+ value: 95.597
449
+ - type: recall_at_1000
450
+ value: 98.97200000000001
451
+ - type: recall_at_20
452
+ value: 87.139
453
+ - type: recall_at_3
454
+ value: 65.713
455
+ - type: recall_at_5
456
+ value: 73.213
457
+ - task:
458
+ type: Retrieval
459
+ dataset:
460
+ type: mteb/cqadupstack-gis
461
+ name: MTEB CQADupstackGisRetrieval
462
+ config: default
463
+ split: test
464
+ revision: 5003b3064772da1887988e05400cf3806fe491f2
465
+ metrics:
466
+ - type: map_at_1
467
+ value: 29.834
468
+ - type: map_at_10
469
+ value: 40.363
470
+ - type: map_at_100
471
+ value: 41.559000000000005
472
+ - type: map_at_1000
473
+ value: 41.626000000000005
474
+ - type: map_at_20
475
+ value: 41.160999999999994
476
+ - type: map_at_3
477
+ value: 36.958999999999996
478
+ - type: map_at_5
479
+ value: 38.897999999999996
480
+ - type: mrr_at_1
481
+ value: 32.429
482
+ - type: mrr_at_10
483
+ value: 42.604
484
+ - type: mrr_at_100
485
+ value: 43.54
486
+ - type: mrr_at_1000
487
+ value: 43.59
488
+ - type: mrr_at_20
489
+ value: 43.247
490
+ - type: mrr_at_3
491
+ value: 39.528999999999996
492
+ - type: mrr_at_5
493
+ value: 41.36
494
+ - type: ndcg_at_1
495
+ value: 32.429
496
+ - type: ndcg_at_10
497
+ value: 46.39
498
+ - type: ndcg_at_100
499
+ value: 51.561
500
+ - type: ndcg_at_1000
501
+ value: 53.071
502
+ - type: ndcg_at_20
503
+ value: 48.951
504
+ - type: ndcg_at_3
505
+ value: 39.796
506
+ - type: ndcg_at_5
507
+ value: 43.07
508
+ - type: precision_at_1
509
+ value: 32.429
510
+ - type: precision_at_10
511
+ value: 7.277
512
+ - type: precision_at_100
513
+ value: 1.038
514
+ - type: precision_at_1000
515
+ value: 0.11900000000000001
516
+ - type: precision_at_20
517
+ value: 4.249
518
+ - type: precision_at_3
519
+ value: 17.024
520
+ - type: precision_at_5
521
+ value: 12.113
522
+ - type: recall_at_1
523
+ value: 29.834
524
+ - type: recall_at_10
525
+ value: 62.808
526
+ - type: recall_at_100
527
+ value: 85.47200000000001
528
+ - type: recall_at_1000
529
+ value: 96.503
530
+ - type: recall_at_20
531
+ value: 72.246
532
+ - type: recall_at_3
533
+ value: 45.059
534
+ - type: recall_at_5
535
+ value: 52.907000000000004
536
+ - task:
537
+ type: Retrieval
538
+ dataset:
539
+ type: mteb/cqadupstack-mathematica
540
+ name: MTEB CQADupstackMathematicaRetrieval
541
+ config: default
542
+ split: test
543
+ revision: 90fceea13679c63fe563ded68f3b6f06e50061de
544
+ metrics:
545
+ - type: map_at_1
546
+ value: 22.121
547
+ - type: map_at_10
548
+ value: 33.217
549
+ - type: map_at_100
550
+ value: 34.671
551
+ - type: map_at_1000
552
+ value: 34.77
553
+ - type: map_at_20
554
+ value: 34.039
555
+ - type: map_at_3
556
+ value: 29.389
557
+ - type: map_at_5
558
+ value: 31.749
559
+ - type: mrr_at_1
560
+ value: 27.114
561
+ - type: mrr_at_10
562
+ value: 37.730999999999995
563
+ - type: mrr_at_100
564
+ value: 38.673
565
+ - type: mrr_at_1000
566
+ value: 38.725
567
+ - type: mrr_at_20
568
+ value: 38.279
569
+ - type: mrr_at_3
570
+ value: 34.494
571
+ - type: mrr_at_5
572
+ value: 36.609
573
+ - type: ndcg_at_1
574
+ value: 27.114
575
+ - type: ndcg_at_10
576
+ value: 39.723000000000006
577
+ - type: ndcg_at_100
578
+ value: 45.847
579
+ - type: ndcg_at_1000
580
+ value: 47.879
581
+ - type: ndcg_at_20
582
+ value: 42.129
583
+ - type: ndcg_at_3
584
+ value: 33.194
585
+ - type: ndcg_at_5
586
+ value: 36.763
587
+ - type: precision_at_1
588
+ value: 27.114
589
+ - type: precision_at_10
590
+ value: 7.575
591
+ - type: precision_at_100
592
+ value: 1.218
593
+ - type: precision_at_1000
594
+ value: 0.15
595
+ - type: precision_at_20
596
+ value: 4.527
597
+ - type: precision_at_3
598
+ value: 16.252
599
+ - type: precision_at_5
600
+ value: 12.363
601
+ - type: recall_at_1
602
+ value: 22.121
603
+ - type: recall_at_10
604
+ value: 54.726
605
+ - type: recall_at_100
606
+ value: 80.662
607
+ - type: recall_at_1000
608
+ value: 94.645
609
+ - type: recall_at_20
610
+ value: 62.977000000000004
611
+ - type: recall_at_3
612
+ value: 37.348
613
+ - type: recall_at_5
614
+ value: 46.163
615
+ - task:
616
+ type: Retrieval
617
+ dataset:
618
+ type: mteb/cqadupstack-physics
619
+ name: MTEB CQADupstackPhysicsRetrieval
620
+ config: default
621
+ split: test
622
+ revision: 79531abbd1fb92d06c6d6315a0cbbbf5bb247ea4
623
+ metrics:
624
+ - type: map_at_1
625
+ value: 36.346000000000004
626
+ - type: map_at_10
627
+ value: 50.034
628
+ - type: map_at_100
629
+ value: 51.37500000000001
630
+ - type: map_at_1000
631
+ value: 51.464
632
+ - type: map_at_20
633
+ value: 50.739999999999995
634
+ - type: map_at_3
635
+ value: 45.948
636
+ - type: map_at_5
637
+ value: 48.421
638
+ - type: mrr_at_1
639
+ value: 45.043
640
+ - type: mrr_at_10
641
+ value: 55.642
642
+ - type: mrr_at_100
643
+ value: 56.335
644
+ - type: mrr_at_1000
645
+ value: 56.355999999999995
646
+ - type: mrr_at_20
647
+ value: 56.027
648
+ - type: mrr_at_3
649
+ value: 53.224000000000004
650
+ - type: mrr_at_5
651
+ value: 54.798
652
+ - type: ndcg_at_1
653
+ value: 45.043
654
+ - type: ndcg_at_10
655
+ value: 56.627
656
+ - type: ndcg_at_100
657
+ value: 61.751
658
+ - type: ndcg_at_1000
659
+ value: 62.873999999999995
660
+ - type: ndcg_at_20
661
+ value: 58.521
662
+ - type: ndcg_at_3
663
+ value: 50.995999999999995
664
+ - type: ndcg_at_5
665
+ value: 54.049
666
+ - type: precision_at_1
667
+ value: 45.043
668
+ - type: precision_at_10
669
+ value: 10.51
670
+ - type: precision_at_100
671
+ value: 1.521
672
+ - type: precision_at_1000
673
+ value: 0.179
674
+ - type: precision_at_20
675
+ value: 5.958
676
+ - type: precision_at_3
677
+ value: 24.703
678
+ - type: precision_at_5
679
+ value: 17.671
680
+ - type: recall_at_1
681
+ value: 36.346000000000004
682
+ - type: recall_at_10
683
+ value: 69.95
684
+ - type: recall_at_100
685
+ value: 91.449
686
+ - type: recall_at_1000
687
+ value: 98.021
688
+ - type: recall_at_20
689
+ value: 76.522
690
+ - type: recall_at_3
691
+ value: 54.348
692
+ - type: recall_at_5
693
+ value: 62.271
694
+ - task:
695
+ type: Retrieval
696
+ dataset:
697
+ type: mteb/cqadupstack-programmers
698
+ name: MTEB CQADupstackProgrammersRetrieval
699
+ config: default
700
+ split: test
701
+ revision: 6184bc1440d2dbc7612be22b50686b8826d22b32
702
+ metrics:
703
+ - type: map_at_1
704
+ value: 28.754
705
+ - type: map_at_10
706
+ value: 42.921
707
+ - type: map_at_100
708
+ value: 44.440000000000005
709
+ - type: map_at_1000
710
+ value: 44.516
711
+ - type: map_at_20
712
+ value: 43.815
713
+ - type: map_at_3
714
+ value: 38.592999999999996
715
+ - type: map_at_5
716
+ value: 41.138999999999996
717
+ - type: mrr_at_1
718
+ value: 36.416
719
+ - type: mrr_at_10
720
+ value: 48.284
721
+ - type: mrr_at_100
722
+ value: 49.086
723
+ - type: mrr_at_1000
724
+ value: 49.116
725
+ - type: mrr_at_20
726
+ value: 48.741
727
+ - type: mrr_at_3
728
+ value: 45.301
729
+ - type: mrr_at_5
730
+ value: 47.104
731
+ - type: ndcg_at_1
732
+ value: 36.416
733
+ - type: ndcg_at_10
734
+ value: 50.257
735
+ - type: ndcg_at_100
736
+ value: 55.931
737
+ - type: ndcg_at_1000
738
+ value: 57.188
739
+ - type: ndcg_at_20
740
+ value: 52.607000000000006
741
+ - type: ndcg_at_3
742
+ value: 43.787
743
+ - type: ndcg_at_5
744
+ value: 46.941
745
+ - type: precision_at_1
746
+ value: 36.416
747
+ - type: precision_at_10
748
+ value: 9.783
749
+ - type: precision_at_100
750
+ value: 1.465
751
+ - type: precision_at_1000
752
+ value: 0.173
753
+ - type: precision_at_20
754
+ value: 5.713
755
+ - type: precision_at_3
756
+ value: 21.804000000000002
757
+ - type: precision_at_5
758
+ value: 16.05
759
+ - type: recall_at_1
760
+ value: 28.754
761
+ - type: recall_at_10
762
+ value: 66.31099999999999
763
+ - type: recall_at_100
764
+ value: 90.034
765
+ - type: recall_at_1000
766
+ value: 98.058
767
+ - type: recall_at_20
768
+ value: 74.411
769
+ - type: recall_at_3
770
+ value: 48.332
771
+ - type: recall_at_5
772
+ value: 56.548
773
+ - task:
774
+ type: Retrieval
775
+ dataset:
776
+ type: mteb/cqadupstack
777
+ name: MTEB CQADupstackRetrieval
778
+ config: default
779
+ split: test
780
+ revision: 5003b3064772da1887988e05400cf3806fe491f2
781
+ metrics:
782
+ - type: map_at_1
783
+ value: 30.579583333333332
784
+ - type: map_at_10
785
+ value: 42.696333333333335
786
+ - type: map_at_100
787
+ value: 44.078583333333334
788
+ - type: map_at_1000
789
+ value: 44.176333333333325
790
+ - type: map_at_20
791
+ value: 43.499833333333335
792
+ - type: map_at_3
793
+ value: 38.953583333333334
794
+ - type: map_at_5
795
+ value: 41.125583333333324
796
+ - type: mrr_at_1
797
+ value: 36.52666666666667
798
+ - type: mrr_at_10
799
+ value: 46.925666666666665
800
+ - type: mrr_at_100
801
+ value: 47.74333333333334
802
+ - type: mrr_at_1000
803
+ value: 47.78266666666667
804
+ - type: mrr_at_20
805
+ value: 47.42483333333333
806
+ - type: mrr_at_3
807
+ value: 44.068083333333334
808
+ - type: mrr_at_5
809
+ value: 45.82383333333333
810
+ - type: ndcg_at_1
811
+ value: 36.52666666666667
812
+ - type: ndcg_at_10
813
+ value: 49.1145
814
+ - type: ndcg_at_100
815
+ value: 54.340583333333335
816
+ - type: ndcg_at_1000
817
+ value: 55.90625
818
+ - type: ndcg_at_20
819
+ value: 51.32724999999999
820
+ - type: ndcg_at_3
821
+ value: 43.146
822
+ - type: ndcg_at_5
823
+ value: 46.146166666666666
824
+ - type: precision_at_1
825
+ value: 36.52666666666667
826
+ - type: precision_at_10
827
+ value: 8.866916666666667
828
+ - type: precision_at_100
829
+ value: 1.3526666666666667
830
+ - type: precision_at_1000
831
+ value: 0.1670833333333333
832
+ - type: precision_at_20
833
+ value: 5.199416666666667
834
+ - type: precision_at_3
835
+ value: 20.278333333333332
836
+ - type: precision_at_5
837
+ value: 14.614999999999997
838
+ - type: recall_at_1
839
+ value: 30.579583333333332
840
+ - type: recall_at_10
841
+ value: 63.618416666666675
842
+ - type: recall_at_100
843
+ value: 85.86858333333332
844
+ - type: recall_at_1000
845
+ value: 96.24825
846
+ - type: recall_at_20
847
+ value: 71.52533333333334
848
+ - type: recall_at_3
849
+ value: 47.18050000000001
850
+ - type: recall_at_5
851
+ value: 54.90683333333334
852
+ - task:
853
+ type: Retrieval
854
+ dataset:
855
+ type: mteb/cqadupstack-stats
856
+ name: MTEB CQADupstackStatsRetrieval
857
+ config: default
858
+ split: test
859
+ revision: 65ac3a16b8e91f9cee4c9828cc7c335575432a2a
860
+ metrics:
861
+ - type: map_at_1
862
+ value: 26.180999999999997
863
+ - type: map_at_10
864
+ value: 36.4
865
+ - type: map_at_100
866
+ value: 37.464999999999996
867
+ - type: map_at_1000
868
+ value: 37.556
869
+ - type: map_at_20
870
+ value: 36.984
871
+ - type: map_at_3
872
+ value: 33.354
873
+ - type: map_at_5
874
+ value: 35.214
875
+ - type: mrr_at_1
876
+ value: 29.601
877
+ - type: mrr_at_10
878
+ value: 39.328
879
+ - type: mrr_at_100
880
+ value: 40.113
881
+ - type: mrr_at_1000
882
+ value: 40.176
883
+ - type: mrr_at_20
884
+ value: 39.751999999999995
885
+ - type: mrr_at_3
886
+ value: 36.58
887
+ - type: mrr_at_5
888
+ value: 38.313
889
+ - type: ndcg_at_1
890
+ value: 29.601
891
+ - type: ndcg_at_10
892
+ value: 42.037
893
+ - type: ndcg_at_100
894
+ value: 46.946
895
+ - type: ndcg_at_1000
896
+ value: 49.075
897
+ - type: ndcg_at_20
898
+ value: 43.827
899
+ - type: ndcg_at_3
900
+ value: 36.473
901
+ - type: ndcg_at_5
902
+ value: 39.482
903
+ - type: precision_at_1
904
+ value: 29.601
905
+ - type: precision_at_10
906
+ value: 7.009
907
+ - type: precision_at_100
908
+ value: 1.0290000000000001
909
+ - type: precision_at_1000
910
+ value: 0.129
911
+ - type: precision_at_20
912
+ value: 4.018
913
+ - type: precision_at_3
914
+ value: 16.36
915
+ - type: precision_at_5
916
+ value: 11.779
917
+ - type: recall_at_1
918
+ value: 26.180999999999997
919
+ - type: recall_at_10
920
+ value: 56.275
921
+ - type: recall_at_100
922
+ value: 78.61200000000001
923
+ - type: recall_at_1000
924
+ value: 93.887
925
+ - type: recall_at_20
926
+ value: 62.798
927
+ - type: recall_at_3
928
+ value: 41.157
929
+ - type: recall_at_5
930
+ value: 48.49
931
+ - task:
932
+ type: Retrieval
933
+ dataset:
934
+ type: mteb/cqadupstack-tex
935
+ name: MTEB CQADupstackTexRetrieval
936
+ config: default
937
+ split: test
938
+ revision: 46989137a86843e03a6195de44b09deda022eec7
939
+ metrics:
940
+ - type: map_at_1
941
+ value: 20.205000000000002
942
+ - type: map_at_10
943
+ value: 29.947000000000003
944
+ - type: map_at_100
945
+ value: 31.342
946
+ - type: map_at_1000
947
+ value: 31.458000000000002
948
+ - type: map_at_20
949
+ value: 30.741000000000003
950
+ - type: map_at_3
951
+ value: 26.568
952
+ - type: map_at_5
953
+ value: 28.372999999999998
954
+ - type: mrr_at_1
955
+ value: 24.742
956
+ - type: mrr_at_10
957
+ value: 33.941
958
+ - type: mrr_at_100
959
+ value: 34.92
960
+ - type: mrr_at_1000
961
+ value: 34.981
962
+ - type: mrr_at_20
963
+ value: 34.509
964
+ - type: mrr_at_3
965
+ value: 31.097
966
+ - type: mrr_at_5
967
+ value: 32.631
968
+ - type: ndcg_at_1
969
+ value: 24.742
970
+ - type: ndcg_at_10
971
+ value: 35.884
972
+ - type: ndcg_at_100
973
+ value: 41.839999999999996
974
+ - type: ndcg_at_1000
975
+ value: 44.162
976
+ - type: ndcg_at_20
977
+ value: 38.273
978
+ - type: ndcg_at_3
979
+ value: 30.073
980
+ - type: ndcg_at_5
981
+ value: 32.617000000000004
982
+ - type: precision_at_1
983
+ value: 24.742
984
+ - type: precision_at_10
985
+ value: 6.958
986
+ - type: precision_at_100
987
+ value: 1.155
988
+ - type: precision_at_1000
989
+ value: 0.154
990
+ - type: precision_at_20
991
+ value: 4.202
992
+ - type: precision_at_3
993
+ value: 14.568
994
+ - type: precision_at_5
995
+ value: 10.757
996
+ - type: recall_at_1
997
+ value: 20.205000000000002
998
+ - type: recall_at_10
999
+ value: 49.603
1000
+ - type: recall_at_100
1001
+ value: 75.77000000000001
1002
+ - type: recall_at_1000
1003
+ value: 91.767
1004
+ - type: recall_at_20
1005
+ value: 58.309
1006
+ - type: recall_at_3
1007
+ value: 33.353
1008
+ - type: recall_at_5
1009
+ value: 39.947
1010
+ - task:
1011
+ type: Retrieval
1012
+ dataset:
1013
+ type: mteb/cqadupstack-unix
1014
+ name: MTEB CQADupstackUnixRetrieval
1015
+ config: default
1016
+ split: test
1017
+ revision: 6c6430d3a6d36f8d2a829195bc5dc94d7e063e53
1018
+ metrics:
1019
+ - type: map_at_1
1020
+ value: 31.543
1021
+ - type: map_at_10
1022
+ value: 43.895
1023
+ - type: map_at_100
1024
+ value: 45.233000000000004
1025
+ - type: map_at_1000
1026
+ value: 45.314
1027
+ - type: map_at_20
1028
+ value: 44.707
1029
+ - type: map_at_3
1030
+ value: 40.165
1031
+ - type: map_at_5
1032
+ value: 42.353
1033
+ - type: mrr_at_1
1034
+ value: 37.5
1035
+ - type: mrr_at_10
1036
+ value: 47.814
1037
+ - type: mrr_at_100
1038
+ value: 48.701
1039
+ - type: mrr_at_1000
1040
+ value: 48.74
1041
+ - type: mrr_at_20
1042
+ value: 48.378
1043
+ - type: mrr_at_3
1044
+ value: 45.04
1045
+ - type: mrr_at_5
1046
+ value: 46.729
1047
+ - type: ndcg_at_1
1048
+ value: 37.5
1049
+ - type: ndcg_at_10
1050
+ value: 50.312999999999995
1051
+ - type: ndcg_at_100
1052
+ value: 55.696999999999996
1053
+ - type: ndcg_at_1000
1054
+ value: 57.135000000000005
1055
+ - type: ndcg_at_20
1056
+ value: 52.734
1057
+ - type: ndcg_at_3
1058
+ value: 44.263000000000005
1059
+ - type: ndcg_at_5
1060
+ value: 47.268
1061
+ - type: precision_at_1
1062
+ value: 37.5
1063
+ - type: precision_at_10
1064
+ value: 8.871
1065
+ - type: precision_at_100
1066
+ value: 1.278
1067
+ - type: precision_at_1000
1068
+ value: 0.149
1069
+ - type: precision_at_20
1070
+ value: 5.117
1071
+ - type: precision_at_3
1072
+ value: 20.709
1073
+ - type: precision_at_5
1074
+ value: 14.832
1075
+ - type: recall_at_1
1076
+ value: 31.543
1077
+ - type: recall_at_10
1078
+ value: 65.694
1079
+ - type: recall_at_100
1080
+ value: 88.105
1081
+ - type: recall_at_1000
1082
+ value: 97.38
1083
+ - type: recall_at_20
1084
+ value: 74.307
1085
+ - type: recall_at_3
1086
+ value: 49.254999999999995
1087
+ - type: recall_at_5
1088
+ value: 56.85
1089
+ - task:
1090
+ type: Retrieval
1091
+ dataset:
1092
+ type: mteb/cqadupstack-webmasters
1093
+ name: MTEB CQADupstackWebmastersRetrieval
1094
+ config: default
1095
+ split: test
1096
+ revision: 160c094312a0e1facb97e55eeddb698c0abe3571
1097
+ metrics:
1098
+ - type: map_at_1
1099
+ value: 29.325000000000003
1100
+ - type: map_at_10
1101
+ value: 40.653
1102
+ - type: map_at_100
1103
+ value: 42.568
1104
+ - type: map_at_1000
1105
+ value: 42.782
1106
+ - type: map_at_20
1107
+ value: 41.638999999999996
1108
+ - type: map_at_3
1109
+ value: 36.726
1110
+ - type: map_at_5
1111
+ value: 38.911
1112
+ - type: mrr_at_1
1113
+ value: 34.98
1114
+ - type: mrr_at_10
1115
+ value: 45.281
1116
+ - type: mrr_at_100
1117
+ value: 46.255
1118
+ - type: mrr_at_1000
1119
+ value: 46.29
1120
+ - type: mrr_at_20
1121
+ value: 45.94
1122
+ - type: mrr_at_3
1123
+ value: 41.831
1124
+ - type: mrr_at_5
1125
+ value: 44.045
1126
+ - type: ndcg_at_1
1127
+ value: 34.98
1128
+ - type: ndcg_at_10
1129
+ value: 47.629
1130
+ - type: ndcg_at_100
1131
+ value: 53.912000000000006
1132
+ - type: ndcg_at_1000
1133
+ value: 55.48
1134
+ - type: ndcg_at_20
1135
+ value: 50.281
1136
+ - type: ndcg_at_3
1137
+ value: 41.211999999999996
1138
+ - type: ndcg_at_5
1139
+ value: 44.529
1140
+ - type: precision_at_1
1141
+ value: 34.98
1142
+ - type: precision_at_10
1143
+ value: 9.229
1144
+ - type: precision_at_100
1145
+ value: 1.854
1146
+ - type: precision_at_1000
1147
+ value: 0.258
1148
+ - type: precision_at_20
1149
+ value: 5.8500000000000005
1150
+ - type: precision_at_3
1151
+ value: 19.631
1152
+ - type: precision_at_5
1153
+ value: 14.506
1154
+ - type: recall_at_1
1155
+ value: 29.325000000000003
1156
+ - type: recall_at_10
1157
+ value: 61.894000000000005
1158
+ - type: recall_at_100
1159
+ value: 88.684
1160
+ - type: recall_at_1000
1161
+ value: 97.83800000000001
1162
+ - type: recall_at_20
1163
+ value: 71.758
1164
+ - type: recall_at_3
1165
+ value: 44.265
1166
+ - type: recall_at_5
1167
+ value: 53.051
1168
+ - task:
1169
+ type: Retrieval
1170
+ dataset:
1171
+ type: mteb/cqadupstack-wordpress
1172
+ name: MTEB CQADupstackWordpressRetrieval
1173
+ config: default
1174
+ split: test
1175
+ revision: 4ffe81d471b1924886b33c7567bfb200e9eec5c4
1176
+ metrics:
1177
+ - type: map_at_1
1178
+ value: 23.133
1179
+ - type: map_at_10
1180
+ value: 33.263
1181
+ - type: map_at_100
1182
+ value: 34.496
1183
+ - type: map_at_1000
1184
+ value: 34.582
1185
+ - type: map_at_20
1186
+ value: 33.983999999999995
1187
+ - type: map_at_3
1188
+ value: 30.12
1189
+ - type: map_at_5
1190
+ value: 31.906000000000002
1191
+ - type: mrr_at_1
1192
+ value: 25.507999999999996
1193
+ - type: mrr_at_10
1194
+ value: 35.663
1195
+ - type: mrr_at_100
1196
+ value: 36.659000000000006
1197
+ - type: mrr_at_1000
1198
+ value: 36.714
1199
+ - type: mrr_at_20
1200
+ value: 36.236000000000004
1201
+ - type: mrr_at_3
1202
+ value: 32.748
1203
+ - type: mrr_at_5
1204
+ value: 34.365
1205
+ - type: ndcg_at_1
1206
+ value: 25.507999999999996
1207
+ - type: ndcg_at_10
1208
+ value: 38.968
1209
+ - type: ndcg_at_100
1210
+ value: 44.674
1211
+ - type: ndcg_at_1000
1212
+ value: 46.725
1213
+ - type: ndcg_at_20
1214
+ value: 41.282000000000004
1215
+ - type: ndcg_at_3
1216
+ value: 33.038000000000004
1217
+ - type: ndcg_at_5
1218
+ value: 35.909
1219
+ - type: precision_at_1
1220
+ value: 25.507999999999996
1221
+ - type: precision_at_10
1222
+ value: 6.285
1223
+ - type: precision_at_100
1224
+ value: 0.98
1225
+ - type: precision_at_1000
1226
+ value: 0.128
1227
+ - type: precision_at_20
1228
+ value: 3.7249999999999996
1229
+ - type: precision_at_3
1230
+ value: 14.171
1231
+ - type: precision_at_5
1232
+ value: 10.314
1233
+ - type: recall_at_1
1234
+ value: 23.133
1235
+ - type: recall_at_10
1236
+ value: 54.042
1237
+ - type: recall_at_100
1238
+ value: 80.01599999999999
1239
+ - type: recall_at_1000
1240
+ value: 95.05799999999999
1241
+ - type: recall_at_20
1242
+ value: 62.643
1243
+ - type: recall_at_3
1244
+ value: 38.367000000000004
1245
+ - type: recall_at_5
1246
+ value: 45.123000000000005
1247
+ - task:
1248
+ type: Retrieval
1249
+ dataset:
1250
+ type: mteb/climate-fever
1251
+ name: MTEB ClimateFEVER
1252
+ config: default
1253
+ split: test
1254
+ revision: 47f2ac6acb640fc46020b02a5b59fdda04d39380
1255
+ metrics:
1256
+ - type: map_at_1
1257
+ value: 13.923
1258
+ - type: map_at_10
1259
+ value: 23.415
1260
+ - type: map_at_100
1261
+ value: 25.389
1262
+ - type: map_at_1000
1263
+ value: 25.539
1264
+ - type: map_at_20
1265
+ value: 24.462
1266
+ - type: map_at_3
1267
+ value: 19.719
1268
+ - type: map_at_5
1269
+ value: 21.75
1270
+ - type: mrr_at_1
1271
+ value: 31.205
1272
+ - type: mrr_at_10
1273
+ value: 43.196
1274
+ - type: mrr_at_100
1275
+ value: 44.039
1276
+ - type: mrr_at_1000
1277
+ value: 44.071
1278
+ - type: mrr_at_20
1279
+ value: 43.744
1280
+ - type: mrr_at_3
1281
+ value: 40.033
1282
+ - type: mrr_at_5
1283
+ value: 41.967
1284
+ - type: ndcg_at_1
1285
+ value: 31.205
1286
+ - type: ndcg_at_10
1287
+ value: 32.304
1288
+ - type: ndcg_at_100
1289
+ value: 39.717
1290
+ - type: ndcg_at_1000
1291
+ value: 42.559999999999995
1292
+ - type: ndcg_at_20
1293
+ value: 35.166
1294
+ - type: ndcg_at_3
1295
+ value: 26.955000000000002
1296
+ - type: ndcg_at_5
1297
+ value: 28.967
1298
+ - type: precision_at_1
1299
+ value: 31.205
1300
+ - type: precision_at_10
1301
+ value: 9.948
1302
+ - type: precision_at_100
1303
+ value: 1.7870000000000001
1304
+ - type: precision_at_1000
1305
+ value: 0.233
1306
+ - type: precision_at_20
1307
+ value: 6.205
1308
+ - type: precision_at_3
1309
+ value: 20.108999999999998
1310
+ - type: precision_at_5
1311
+ value: 15.453
1312
+ - type: recall_at_1
1313
+ value: 13.923
1314
+ - type: recall_at_10
1315
+ value: 37.885000000000005
1316
+ - type: recall_at_100
1317
+ value: 63.352
1318
+ - type: recall_at_1000
1319
+ value: 79.372
1320
+ - type: recall_at_20
1321
+ value: 45.954
1322
+ - type: recall_at_3
1323
+ value: 24.511
1324
+ - type: recall_at_5
1325
+ value: 30.451
1326
+ - task:
1327
+ type: Retrieval
1328
+ dataset:
1329
+ type: mteb/dbpedia
1330
+ name: MTEB DBPedia
1331
+ config: default
1332
+ split: test
1333
+ revision: c0f706b76e590d620bd6618b3ca8efdd34e2d659
1334
+ metrics:
1335
+ - type: map_at_1
1336
+ value: 9.584
1337
+ - type: map_at_10
1338
+ value: 23.432
1339
+ - type: map_at_100
1340
+ value: 32.513
1341
+ - type: map_at_1000
1342
+ value: 34.27
1343
+ - type: map_at_20
1344
+ value: 27.18
1345
+ - type: map_at_3
1346
+ value: 16.145
1347
+ - type: map_at_5
1348
+ value: 19.405
1349
+ - type: mrr_at_1
1350
+ value: 74.5
1351
+ - type: mrr_at_10
1352
+ value: 81.233
1353
+ - type: mrr_at_100
1354
+ value: 81.463
1355
+ - type: mrr_at_1000
1356
+ value: 81.46900000000001
1357
+ - type: mrr_at_20
1358
+ value: 81.394
1359
+ - type: mrr_at_3
1360
+ value: 79.958
1361
+ - type: mrr_at_5
1362
+ value: 80.808
1363
+ - type: ndcg_at_1
1364
+ value: 62.125
1365
+ - type: ndcg_at_10
1366
+ value: 48.047000000000004
1367
+ - type: ndcg_at_100
1368
+ value: 52.251999999999995
1369
+ - type: ndcg_at_1000
1370
+ value: 59.353
1371
+ - type: ndcg_at_20
1372
+ value: 47.264
1373
+ - type: ndcg_at_3
1374
+ value: 52.891999999999996
1375
+ - type: ndcg_at_5
1376
+ value: 50.766999999999996
1377
+ - type: precision_at_1
1378
+ value: 74.5
1379
+ - type: precision_at_10
1380
+ value: 38.15
1381
+ - type: precision_at_100
1382
+ value: 11.51
1383
+ - type: precision_at_1000
1384
+ value: 2.183
1385
+ - type: precision_at_20
1386
+ value: 28.749999999999996
1387
+ - type: precision_at_3
1388
+ value: 56.25
1389
+ - type: precision_at_5
1390
+ value: 49.1
1391
+ - type: recall_at_1
1392
+ value: 9.584
1393
+ - type: recall_at_10
1394
+ value: 29.215999999999998
1395
+ - type: recall_at_100
1396
+ value: 57.914
1397
+ - type: recall_at_1000
1398
+ value: 80.67699999999999
1399
+ - type: recall_at_20
1400
+ value: 37.358000000000004
1401
+ - type: recall_at_3
1402
+ value: 17.422
1403
+ - type: recall_at_5
1404
+ value: 22.345000000000002
1405
+ - task:
1406
+ type: Classification
1407
+ dataset:
1408
+ type: mteb/emotion
1409
+ name: MTEB EmotionClassification
1410
+ config: default
1411
+ split: test
1412
+ revision: 4f58c6b202a23cf9a4da393831edf4f9183cad37
1413
+ metrics:
1414
+ - type: accuracy
1415
+ value: 91.36000000000001
1416
+ - type: f1
1417
+ value: 87.72724279223316
1418
+ - task:
1419
+ type: Retrieval
1420
+ dataset:
1421
+ type: mteb/fever
1422
+ name: MTEB FEVER
1423
+ config: default
1424
+ split: test
1425
+ revision: bea83ef9e8fb933d90a2f1d5515737465d613e12
1426
+ metrics:
1427
+ - type: map_at_1
1428
+ value: 78.81700000000001
1429
+ - type: map_at_10
1430
+ value: 86.392
1431
+ - type: map_at_100
1432
+ value: 86.6
1433
+ - type: map_at_1000
1434
+ value: 86.611
1435
+ - type: map_at_20
1436
+ value: 86.521
1437
+ - type: map_at_3
1438
+ value: 85.31
1439
+ - type: map_at_5
1440
+ value: 86.047
1441
+ - type: mrr_at_1
1442
+ value: 84.878
1443
+ - type: mrr_at_10
1444
+ value: 90.359
1445
+ - type: mrr_at_100
1446
+ value: 90.426
1447
+ - type: mrr_at_1000
1448
+ value: 90.427
1449
+ - type: mrr_at_20
1450
+ value: 90.405
1451
+ - type: mrr_at_3
1452
+ value: 89.761
1453
+ - type: mrr_at_5
1454
+ value: 90.191
1455
+ - type: ndcg_at_1
1456
+ value: 84.878
1457
+ - type: ndcg_at_10
1458
+ value: 89.459
1459
+ - type: ndcg_at_100
1460
+ value: 90.171
1461
+ - type: ndcg_at_1000
1462
+ value: 90.349
1463
+ - type: ndcg_at_20
1464
+ value: 89.788
1465
+ - type: ndcg_at_3
1466
+ value: 87.908
1467
+ - type: ndcg_at_5
1468
+ value: 88.844
1469
+ - type: precision_at_1
1470
+ value: 84.878
1471
+ - type: precision_at_10
1472
+ value: 10.639
1473
+ - type: precision_at_100
1474
+ value: 1.123
1475
+ - type: precision_at_1000
1476
+ value: 0.11499999999999999
1477
+ - type: precision_at_20
1478
+ value: 5.427
1479
+ - type: precision_at_3
1480
+ value: 33.333
1481
+ - type: precision_at_5
1482
+ value: 20.696
1483
+ - type: recall_at_1
1484
+ value: 78.81700000000001
1485
+ - type: recall_at_10
1486
+ value: 94.959
1487
+ - type: recall_at_100
1488
+ value: 97.72800000000001
1489
+ - type: recall_at_1000
1490
+ value: 98.791
1491
+ - type: recall_at_20
1492
+ value: 96.036
1493
+ - type: recall_at_3
1494
+ value: 90.727
1495
+ - type: recall_at_5
1496
+ value: 93.12899999999999
1497
+ - task:
1498
+ type: Retrieval
1499
+ dataset:
1500
+ type: mteb/fiqa
1501
+ name: MTEB FiQA2018
1502
+ config: default
1503
+ split: test
1504
+ revision: 27a168819829fe9bcd655c2df245fb19452e8e06
1505
+ metrics:
1506
+ - type: map_at_1
1507
+ value: 29.596
1508
+ - type: map_at_10
1509
+ value: 50.833
1510
+ - type: map_at_100
1511
+ value: 53.034000000000006
1512
+ - type: map_at_1000
1513
+ value: 53.135
1514
+ - type: map_at_20
1515
+ value: 52.195
1516
+ - type: map_at_3
1517
+ value: 44.247
1518
+ - type: map_at_5
1519
+ value: 48.107
1520
+ - type: mrr_at_1
1521
+ value: 57.87
1522
+ - type: mrr_at_10
1523
+ value: 65.566
1524
+ - type: mrr_at_100
1525
+ value: 66.15299999999999
1526
+ - type: mrr_at_1000
1527
+ value: 66.168
1528
+ - type: mrr_at_20
1529
+ value: 65.923
1530
+ - type: mrr_at_3
1531
+ value: 63.55499999999999
1532
+ - type: mrr_at_5
1533
+ value: 64.727
1534
+ - type: ndcg_at_1
1535
+ value: 57.87
1536
+ - type: ndcg_at_10
1537
+ value: 58.943999999999996
1538
+ - type: ndcg_at_100
1539
+ value: 65.283
1540
+ - type: ndcg_at_1000
1541
+ value: 66.706
1542
+ - type: ndcg_at_20
1543
+ value: 61.778999999999996
1544
+ - type: ndcg_at_3
1545
+ value: 54.554
1546
+ - type: ndcg_at_5
1547
+ value: 56.159000000000006
1548
+ - type: precision_at_1
1549
+ value: 57.87
1550
+ - type: precision_at_10
1551
+ value: 16.435
1552
+ - type: precision_at_100
1553
+ value: 2.307
1554
+ - type: precision_at_1000
1555
+ value: 0.256
1556
+ - type: precision_at_20
1557
+ value: 9.522
1558
+ - type: precision_at_3
1559
+ value: 36.986000000000004
1560
+ - type: precision_at_5
1561
+ value: 27.16
1562
+ - type: recall_at_1
1563
+ value: 29.596
1564
+ - type: recall_at_10
1565
+ value: 66.705
1566
+ - type: recall_at_100
1567
+ value: 89.45
1568
+ - type: recall_at_1000
1569
+ value: 97.758
1570
+ - type: recall_at_20
1571
+ value: 75.13300000000001
1572
+ - type: recall_at_3
1573
+ value: 49.689
1574
+ - type: recall_at_5
1575
+ value: 57.701
1576
+ - task:
1577
+ type: Retrieval
1578
+ dataset:
1579
+ type: mteb/hotpotqa
1580
+ name: MTEB HotpotQA
1581
+ config: default
1582
+ split: test
1583
+ revision: ab518f4d6fcca38d87c25209f94beba119d02014
1584
+ metrics:
1585
+ - type: map_at_1
1586
+ value: 42.532
1587
+ - type: map_at_10
1588
+ value: 71.931
1589
+ - type: map_at_100
1590
+ value: 72.623
1591
+ - type: map_at_1000
1592
+ value: 72.662
1593
+ - type: map_at_20
1594
+ value: 72.355
1595
+ - type: map_at_3
1596
+ value: 68.72200000000001
1597
+ - type: map_at_5
1598
+ value: 70.813
1599
+ - type: mrr_at_1
1600
+ value: 85.064
1601
+ - type: mrr_at_10
1602
+ value: 89.69500000000001
1603
+ - type: mrr_at_100
1604
+ value: 89.792
1605
+ - type: mrr_at_1000
1606
+ value: 89.795
1607
+ - type: mrr_at_20
1608
+ value: 89.759
1609
+ - type: mrr_at_3
1610
+ value: 89.129
1611
+ - type: mrr_at_5
1612
+ value: 89.5
1613
+ - type: ndcg_at_1
1614
+ value: 85.064
1615
+ - type: ndcg_at_10
1616
+ value: 78.86999999999999
1617
+ - type: ndcg_at_100
1618
+ value: 81.134
1619
+ - type: ndcg_at_1000
1620
+ value: 81.862
1621
+ - type: ndcg_at_20
1622
+ value: 79.888
1623
+ - type: ndcg_at_3
1624
+ value: 74.579
1625
+ - type: ndcg_at_5
1626
+ value: 77.086
1627
+ - type: precision_at_1
1628
+ value: 85.064
1629
+ - type: precision_at_10
1630
+ value: 16.433
1631
+ - type: precision_at_100
1632
+ value: 1.818
1633
+ - type: precision_at_1000
1634
+ value: 0.191
1635
+ - type: precision_at_20
1636
+ value: 8.545
1637
+ - type: precision_at_3
1638
+ value: 48.508
1639
+ - type: precision_at_5
1640
+ value: 31.084
1641
+ - type: recall_at_1
1642
+ value: 42.532
1643
+ - type: recall_at_10
1644
+ value: 82.167
1645
+ - type: recall_at_100
1646
+ value: 90.905
1647
+ - type: recall_at_1000
1648
+ value: 95.699
1649
+ - type: recall_at_20
1650
+ value: 85.449
1651
+ - type: recall_at_3
1652
+ value: 72.762
1653
+ - type: recall_at_5
1654
+ value: 77.711
1655
+ - task:
1656
+ type: Classification
1657
+ dataset:
1658
+ type: mteb/imdb
1659
+ name: MTEB ImdbClassification
1660
+ config: default
1661
+ split: test
1662
+ revision: 3d86128a09e091d6018b6d26cad27f2739fc2db7
1663
+ metrics:
1664
+ - type: accuracy
1665
+ value: 96.91919999999999
1666
+ - type: ap
1667
+ value: 95.88443935380744
1668
+ - type: f1
1669
+ value: 96.91873838978964
1670
+ - task:
1671
+ type: Retrieval
1672
+ dataset:
1673
+ type: mteb/msmarco
1674
+ name: MTEB MSMARCO
1675
+ config: default
1676
+ split: dev
1677
+ revision: c5a29a104738b98a9e76336939199e264163d4a0
1678
+ metrics:
1679
+ - type: map_at_1
1680
+ value: 21.747
1681
+ - type: map_at_10
1682
+ value: 34.764
1683
+ - type: map_at_100
1684
+ value: 35.981
1685
+ - type: map_at_1000
1686
+ value: 36.027
1687
+ - type: map_at_20
1688
+ value: 35.557
1689
+ - type: map_at_3
1690
+ value: 30.770999999999997
1691
+ - type: map_at_5
1692
+ value: 33.07
1693
+ - type: mrr_at_1
1694
+ value: 22.421
1695
+ - type: mrr_at_10
1696
+ value: 35.417
1697
+ - type: mrr_at_100
1698
+ value: 36.57
1699
+ - type: mrr_at_1000
1700
+ value: 36.61
1701
+ - type: mrr_at_20
1702
+ value: 36.174
1703
+ - type: mrr_at_3
1704
+ value: 31.516
1705
+ - type: mrr_at_5
1706
+ value: 33.783
1707
+ - type: ndcg_at_1
1708
+ value: 22.421
1709
+ - type: ndcg_at_10
1710
+ value: 42.003
1711
+ - type: ndcg_at_100
1712
+ value: 47.674
1713
+ - type: ndcg_at_1000
1714
+ value: 48.783
1715
+ - type: ndcg_at_20
1716
+ value: 44.789
1717
+ - type: ndcg_at_3
1718
+ value: 33.918
1719
+ - type: ndcg_at_5
1720
+ value: 38.011
1721
+ - type: precision_at_1
1722
+ value: 22.421
1723
+ - type: precision_at_10
1724
+ value: 6.712
1725
+ - type: precision_at_100
1726
+ value: 0.9520000000000001
1727
+ - type: precision_at_1000
1728
+ value: 0.105
1729
+ - type: precision_at_20
1730
+ value: 3.9309999999999996
1731
+ - type: precision_at_3
1732
+ value: 14.632000000000001
1733
+ - type: precision_at_5
1734
+ value: 10.845
1735
+ - type: recall_at_1
1736
+ value: 21.747
1737
+ - type: recall_at_10
1738
+ value: 64.2
1739
+ - type: recall_at_100
1740
+ value: 90.04100000000001
1741
+ - type: recall_at_1000
1742
+ value: 98.41499999999999
1743
+ - type: recall_at_20
1744
+ value: 74.982
1745
+ - type: recall_at_3
1746
+ value: 42.303000000000004
1747
+ - type: recall_at_5
1748
+ value: 52.11
1749
+ - task:
1750
+ type: Classification
1751
+ dataset:
1752
+ type: mteb/mtop_domain
1753
+ name: MTEB MTOPDomainClassification (en)
1754
+ config: en
1755
+ split: test
1756
+ revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf
1757
+ metrics:
1758
+ - type: accuracy
1759
+ value: 99.02872777017784
1760
+ - type: f1
1761
+ value: 98.8785703018425
1762
+ - task:
1763
+ type: Classification
1764
+ dataset:
1765
+ type: mteb/mtop_intent
1766
+ name: MTEB MTOPIntentClassification (en)
1767
+ config: en
1768
+ split: test
1769
+ revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba
1770
+ metrics:
1771
+ - type: accuracy
1772
+ value: 90.93935248518011
1773
+ - type: f1
1774
+ value: 75.46510480635821
1775
+ - task:
1776
+ type: Classification
1777
+ dataset:
1778
+ type: mteb/amazon_massive_intent
1779
+ name: MTEB MassiveIntentClassification (en)
1780
+ config: en
1781
+ split: test
1782
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1783
+ metrics:
1784
+ - type: accuracy
1785
+ value: 82.49831876260927
1786
+ - type: f1
1787
+ value: 79.43439001730579
1788
+ - task:
1789
+ type: Classification
1790
+ dataset:
1791
+ type: mteb/amazon_massive_scenario
1792
+ name: MTEB MassiveScenarioClassification (en)
1793
+ config: en
1794
+ split: test
1795
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1796
+ metrics:
1797
+ - type: accuracy
1798
+ value: 84.50235373234702
1799
+ - type: f1
1800
+ value: 84.03906668934695
1801
+ - task:
1802
+ type: Clustering
1803
+ dataset:
1804
+ type: mteb/medrxiv-clustering-p2p
1805
+ name: MTEB MedrxivClusteringP2P
1806
+ config: default
1807
+ split: test
1808
+ revision: e7a26af6f3ae46b30dde8737f02c07b1505bcc73
1809
+ metrics:
1810
+ - type: v_measure
1811
+ value: 42.634572576984716
1812
+ - task:
1813
+ type: Clustering
1814
+ dataset:
1815
+ type: mteb/medrxiv-clustering-s2s
1816
+ name: MTEB MedrxivClusteringS2S
1817
+ config: default
1818
+ split: test
1819
+ revision: 35191c8c0dca72d8ff3efcd72aa802307d469663
1820
+ metrics:
1821
+ - type: v_measure
1822
+ value: 40.96861872930255
1823
+ - task:
1824
+ type: Reranking
1825
+ dataset:
1826
+ type: mteb/mind_small
1827
+ name: MTEB MindSmallReranking
1828
+ config: default
1829
+ split: test
1830
+ revision: 3bdac13927fdc888b903db93b2ffdbd90b295a69
1831
+ metrics:
1832
+ - type: map
1833
+ value: 31.986207669202933
1834
+ - type: mrr
1835
+ value: 33.11375583060012
1836
+ - task:
1837
+ type: Retrieval
1838
+ dataset:
1839
+ type: mteb/nfcorpus
1840
+ name: MTEB NFCorpus
1841
+ config: default
1842
+ split: test
1843
+ revision: ec0fa4fe99da2ff19ca1214b7966684033a58814
1844
+ metrics:
1845
+ - type: map_at_1
1846
+ value: 6.783
1847
+ - type: map_at_10
1848
+ value: 16.276
1849
+ - type: map_at_100
1850
+ value: 21.324
1851
+ - type: map_at_1000
1852
+ value: 23.166
1853
+ - type: map_at_20
1854
+ value: 18.383
1855
+ - type: map_at_3
1856
+ value: 11.296000000000001
1857
+ - type: map_at_5
1858
+ value: 13.504
1859
+ - type: mrr_at_1
1860
+ value: 53.559999999999995
1861
+ - type: mrr_at_10
1862
+ value: 61.589000000000006
1863
+ - type: mrr_at_100
1864
+ value: 62.11600000000001
1865
+ - type: mrr_at_1000
1866
+ value: 62.158
1867
+ - type: mrr_at_20
1868
+ value: 61.976
1869
+ - type: mrr_at_3
1870
+ value: 59.855999999999995
1871
+ - type: mrr_at_5
1872
+ value: 60.877
1873
+ - type: ndcg_at_1
1874
+ value: 50.15500000000001
1875
+ - type: ndcg_at_10
1876
+ value: 42.598
1877
+ - type: ndcg_at_100
1878
+ value: 39.15
1879
+ - type: ndcg_at_1000
1880
+ value: 47.888999999999996
1881
+ - type: ndcg_at_20
1882
+ value: 39.956
1883
+ - type: ndcg_at_3
1884
+ value: 46.836
1885
+ - type: ndcg_at_5
1886
+ value: 45.001000000000005
1887
+ - type: precision_at_1
1888
+ value: 52.322
1889
+ - type: precision_at_10
1890
+ value: 32.601
1891
+ - type: precision_at_100
1892
+ value: 10.145999999999999
1893
+ - type: precision_at_1000
1894
+ value: 2.358
1895
+ - type: precision_at_20
1896
+ value: 24.025
1897
+ - type: precision_at_3
1898
+ value: 44.169000000000004
1899
+ - type: precision_at_5
1900
+ value: 39.628
1901
+ - type: recall_at_1
1902
+ value: 6.783
1903
+ - type: recall_at_10
1904
+ value: 21.175
1905
+ - type: recall_at_100
1906
+ value: 40.097
1907
+ - type: recall_at_1000
1908
+ value: 71.65
1909
+ - type: recall_at_20
1910
+ value: 26.465
1911
+ - type: recall_at_3
1912
+ value: 12.589
1913
+ - type: recall_at_5
1914
+ value: 15.867999999999999
1915
+ - task:
1916
+ type: Retrieval
1917
+ dataset:
1918
+ type: mteb/nq
1919
+ name: MTEB NQ
1920
+ config: default
1921
+ split: test
1922
+ revision: b774495ed302d8c44a3a7ea25c90dbce03968f31
1923
+ metrics:
1924
+ - type: map_at_1
1925
+ value: 43.376
1926
+ - type: map_at_10
1927
+ value: 60.968
1928
+ - type: map_at_100
1929
+ value: 61.614999999999995
1930
+ - type: map_at_1000
1931
+ value: 61.626000000000005
1932
+ - type: map_at_20
1933
+ value: 61.441
1934
+ - type: map_at_3
1935
+ value: 56.858
1936
+ - type: map_at_5
1937
+ value: 59.476
1938
+ - type: mrr_at_1
1939
+ value: 48.841
1940
+ - type: mrr_at_10
1941
+ value: 63.366
1942
+ - type: mrr_at_100
1943
+ value: 63.79
1944
+ - type: mrr_at_1000
1945
+ value: 63.797000000000004
1946
+ - type: mrr_at_20
1947
+ value: 63.682
1948
+ - type: mrr_at_3
1949
+ value: 60.535000000000004
1950
+ - type: mrr_at_5
1951
+ value: 62.348000000000006
1952
+ - type: ndcg_at_1
1953
+ value: 48.841
1954
+ - type: ndcg_at_10
1955
+ value: 68.362
1956
+ - type: ndcg_at_100
1957
+ value: 70.799
1958
+ - type: ndcg_at_1000
1959
+ value: 71.004
1960
+ - type: ndcg_at_20
1961
+ value: 69.804
1962
+ - type: ndcg_at_3
1963
+ value: 61.251
1964
+ - type: ndcg_at_5
1965
+ value: 65.28500000000001
1966
+ - type: precision_at_1
1967
+ value: 48.841
1968
+ - type: precision_at_10
1969
+ value: 10.588000000000001
1970
+ - type: precision_at_100
1971
+ value: 1.194
1972
+ - type: precision_at_1000
1973
+ value: 0.121
1974
+ - type: precision_at_20
1975
+ value: 5.646
1976
+ - type: precision_at_3
1977
+ value: 27.298000000000002
1978
+ - type: precision_at_5
1979
+ value: 18.841
1980
+ - type: recall_at_1
1981
+ value: 43.376
1982
+ - type: recall_at_10
1983
+ value: 88.053
1984
+ - type: recall_at_100
1985
+ value: 98.194
1986
+ - type: recall_at_1000
1987
+ value: 99.67200000000001
1988
+ - type: recall_at_20
1989
+ value: 93.318
1990
+ - type: recall_at_3
1991
+ value: 70.281
1992
+ - type: recall_at_5
1993
+ value: 79.28
1994
+ - task:
1995
+ type: Retrieval
1996
+ dataset:
1997
+ type: mteb/quora
1998
+ name: MTEB QuoraRetrieval
1999
+ config: default
2000
+ split: test
2001
+ revision: e4e08e0b7dbe3c8700f0daef558ff32256715259
2002
+ metrics:
2003
+ - type: map_at_1
2004
+ value: 71.477
2005
+ - type: map_at_10
2006
+ value: 85.548
2007
+ - type: map_at_100
2008
+ value: 86.187
2009
+ - type: map_at_1000
2010
+ value: 86.199
2011
+ - type: map_at_20
2012
+ value: 85.971
2013
+ - type: map_at_3
2014
+ value: 82.50999999999999
2015
+ - type: map_at_5
2016
+ value: 84.447
2017
+ - type: mrr_at_1
2018
+ value: 82.35
2019
+ - type: mrr_at_10
2020
+ value: 88.039
2021
+ - type: mrr_at_100
2022
+ value: 88.14699999999999
2023
+ - type: mrr_at_1000
2024
+ value: 88.14699999999999
2025
+ - type: mrr_at_20
2026
+ value: 88.12100000000001
2027
+ - type: mrr_at_3
2028
+ value: 87.048
2029
+ - type: mrr_at_5
2030
+ value: 87.73100000000001
2031
+ - type: ndcg_at_1
2032
+ value: 82.35
2033
+ - type: ndcg_at_10
2034
+ value: 89.024
2035
+ - type: ndcg_at_100
2036
+ value: 90.18599999999999
2037
+ - type: ndcg_at_1000
2038
+ value: 90.245
2039
+ - type: ndcg_at_20
2040
+ value: 89.67399999999999
2041
+ - type: ndcg_at_3
2042
+ value: 86.167
2043
+ - type: ndcg_at_5
2044
+ value: 87.779
2045
+ - type: precision_at_1
2046
+ value: 82.35
2047
+ - type: precision_at_10
2048
+ value: 13.565
2049
+ - type: precision_at_100
2050
+ value: 1.544
2051
+ - type: precision_at_1000
2052
+ value: 0.157
2053
+ - type: precision_at_20
2054
+ value: 7.2010000000000005
2055
+ - type: precision_at_3
2056
+ value: 37.773
2057
+ - type: precision_at_5
2058
+ value: 24.924
2059
+ - type: recall_at_1
2060
+ value: 71.477
2061
+ - type: recall_at_10
2062
+ value: 95.821
2063
+ - type: recall_at_100
2064
+ value: 99.737
2065
+ - type: recall_at_1000
2066
+ value: 99.98599999999999
2067
+ - type: recall_at_20
2068
+ value: 97.90100000000001
2069
+ - type: recall_at_3
2070
+ value: 87.61
2071
+ - type: recall_at_5
2072
+ value: 92.135
2073
+ - task:
2074
+ type: Clustering
2075
+ dataset:
2076
+ type: mteb/reddit-clustering
2077
+ name: MTEB RedditClustering
2078
+ config: default
2079
+ split: test
2080
+ revision: 24640382cdbf8abc73003fb0fa6d111a705499eb
2081
+ metrics:
2082
+ - type: v_measure
2083
+ value: 66.43811157811552
2084
+ - task:
2085
+ type: Clustering
2086
+ dataset:
2087
+ type: mteb/reddit-clustering-p2p
2088
+ name: MTEB RedditClusteringP2P
2089
+ config: default
2090
+ split: test
2091
+ revision: 385e3cb46b4cfa89021f56c4380204149d0efe33
2092
+ metrics:
2093
+ - type: v_measure
2094
+ value: 69.56403346330322
2095
+ - task:
2096
+ type: Retrieval
2097
+ dataset:
2098
+ type: mteb/scidocs
2099
+ name: MTEB SCIDOCS
2100
+ config: default
2101
+ split: test
2102
+ revision: f8c2fcf00f625baaa80f62ec5bd9e1fff3b8ae88
2103
+ metrics:
2104
+ - type: map_at_1
2105
+ value: 6.253
2106
+ - type: map_at_10
2107
+ value: 17.379
2108
+ - type: map_at_100
2109
+ value: 20.51
2110
+ - type: map_at_1000
2111
+ value: 20.881
2112
+ - type: map_at_20
2113
+ value: 18.983
2114
+ - type: map_at_3
2115
+ value: 12.061
2116
+ - type: map_at_5
2117
+ value: 14.546000000000001
2118
+ - type: mrr_at_1
2119
+ value: 30.8
2120
+ - type: mrr_at_10
2121
+ value: 43.814
2122
+ - type: mrr_at_100
2123
+ value: 44.883
2124
+ - type: mrr_at_1000
2125
+ value: 44.906
2126
+ - type: mrr_at_20
2127
+ value: 44.555
2128
+ - type: mrr_at_3
2129
+ value: 40.416999999999994
2130
+ - type: mrr_at_5
2131
+ value: 42.482
2132
+ - type: ndcg_at_1
2133
+ value: 30.8
2134
+ - type: ndcg_at_10
2135
+ value: 27.694999999999997
2136
+ - type: ndcg_at_100
2137
+ value: 38.248
2138
+ - type: ndcg_at_1000
2139
+ value: 43.547000000000004
2140
+ - type: ndcg_at_20
2141
+ value: 31.573
2142
+ - type: ndcg_at_3
2143
+ value: 26.239
2144
+ - type: ndcg_at_5
2145
+ value: 22.817999999999998
2146
+ - type: precision_at_1
2147
+ value: 30.8
2148
+ - type: precision_at_10
2149
+ value: 14.540000000000001
2150
+ - type: precision_at_100
2151
+ value: 2.9690000000000003
2152
+ - type: precision_at_1000
2153
+ value: 0.422
2154
+ - type: precision_at_20
2155
+ value: 9.5
2156
+ - type: precision_at_3
2157
+ value: 24.967
2158
+ - type: precision_at_5
2159
+ value: 20.22
2160
+ - type: recall_at_1
2161
+ value: 6.253
2162
+ - type: recall_at_10
2163
+ value: 29.465000000000003
2164
+ - type: recall_at_100
2165
+ value: 60.28
2166
+ - type: recall_at_1000
2167
+ value: 85.712
2168
+ - type: recall_at_20
2169
+ value: 38.578
2170
+ - type: recall_at_3
2171
+ value: 15.201999999999998
2172
+ - type: recall_at_5
2173
+ value: 20.507
2174
+ - task:
2175
+ type: STS
2176
+ dataset:
2177
+ type: mteb/sickr-sts
2178
+ name: MTEB SICK-R
2179
+ config: default
2180
+ split: test
2181
+ revision: 20a6d6f312dd54037fe07a32d58e5e168867909d
2182
+ metrics:
2183
+ - type: cos_sim_pearson
2184
+ value: 86.88263045065128
2185
+ - type: cos_sim_spearman
2186
+ value: 83.2199052396249
2187
+ - type: euclidean_pearson
2188
+ value: 83.89316748784084
2189
+ - type: euclidean_spearman
2190
+ value: 82.80089923470608
2191
+ - type: manhattan_pearson
2192
+ value: 83.79340504513027
2193
+ - type: manhattan_spearman
2194
+ value: 82.57647453394455
2195
+ - task:
2196
+ type: STS
2197
+ dataset:
2198
+ type: mteb/sts12-sts
2199
+ name: MTEB STS12
2200
+ config: default
2201
+ split: test
2202
+ revision: a0d554a64d88156834ff5ae9920b964011b16384
2203
+ metrics:
2204
+ - type: cos_sim_pearson
2205
+ value: 87.23417612553622
2206
+ - type: cos_sim_spearman
2207
+ value: 79.40077017685032
2208
+ - type: euclidean_pearson
2209
+ value: 82.98069591415172
2210
+ - type: euclidean_spearman
2211
+ value: 77.72626690650102
2212
+ - type: manhattan_pearson
2213
+ value: 83.2549008896714
2214
+ - type: manhattan_spearman
2215
+ value: 77.97517379409553
2216
+ - task:
2217
+ type: STS
2218
+ dataset:
2219
+ type: mteb/sts13-sts
2220
+ name: MTEB STS13
2221
+ config: default
2222
+ split: test
2223
+ revision: 7e90230a92c190f1bf69ae9002b8cea547a64cca
2224
+ metrics:
2225
+ - type: cos_sim_pearson
2226
+ value: 89.94319057478221
2227
+ - type: cos_sim_spearman
2228
+ value: 89.57673217959568
2229
+ - type: euclidean_pearson
2230
+ value: 88.52164819479393
2231
+ - type: euclidean_spearman
2232
+ value: 89.28792930444656
2233
+ - type: manhattan_pearson
2234
+ value: 88.63748131889201
2235
+ - type: manhattan_spearman
2236
+ value: 89.5337354128652
2237
+ - task:
2238
+ type: STS
2239
+ dataset:
2240
+ type: mteb/sts14-sts
2241
+ name: MTEB STS14
2242
+ config: default
2243
+ split: test
2244
+ revision: 6031580fec1f6af667f0bd2da0a551cf4f0b2375
2245
+ metrics:
2246
+ - type: cos_sim_pearson
2247
+ value: 87.0002285020644
2248
+ - type: cos_sim_spearman
2249
+ value: 84.85558709405255
2250
+ - type: euclidean_pearson
2251
+ value: 85.76743275817024
2252
+ - type: euclidean_spearman
2253
+ value: 84.7900299161083
2254
+ - type: manhattan_pearson
2255
+ value: 85.81372778099167
2256
+ - type: manhattan_spearman
2257
+ value: 84.88975144080597
2258
+ - task:
2259
+ type: STS
2260
+ dataset:
2261
+ type: mteb/sts15-sts
2262
+ name: MTEB STS15
2263
+ config: default
2264
+ split: test
2265
+ revision: ae752c7c21bf194d8b67fd573edf7ae58183cbe3
2266
+ metrics:
2267
+ - type: cos_sim_pearson
2268
+ value: 89.90992300865088
2269
+ - type: cos_sim_spearman
2270
+ value: 89.89952259773258
2271
+ - type: euclidean_pearson
2272
+ value: 88.95472170794739
2273
+ - type: euclidean_spearman
2274
+ value: 89.79840257558794
2275
+ - type: manhattan_pearson
2276
+ value: 89.00903847816028
2277
+ - type: manhattan_spearman
2278
+ value: 89.99292271664685
2279
+ - task:
2280
+ type: STS
2281
+ dataset:
2282
+ type: mteb/sts16-sts
2283
+ name: MTEB STS16
2284
+ config: default
2285
+ split: test
2286
+ revision: 4d8694f8f0e0100860b497b999b3dbed754a0513
2287
+ metrics:
2288
+ - type: cos_sim_pearson
2289
+ value: 85.75044299994977
2290
+ - type: cos_sim_spearman
2291
+ value: 86.31137676221347
2292
+ - type: euclidean_pearson
2293
+ value: 85.03198959400133
2294
+ - type: euclidean_spearman
2295
+ value: 85.62611072515675
2296
+ - type: manhattan_pearson
2297
+ value: 85.11681545306745
2298
+ - type: manhattan_spearman
2299
+ value: 85.75766564037835
2300
+ - task:
2301
+ type: STS
2302
+ dataset:
2303
+ type: mteb/sts17-crosslingual-sts
2304
+ name: MTEB STS17 (en-en)
2305
+ config: en-en
2306
+ split: test
2307
+ revision: af5e6fb845001ecf41f4c1e033ce921939a2a68d
2308
+ metrics:
2309
+ - type: cos_sim_pearson
2310
+ value: 91.85595137809975
2311
+ - type: cos_sim_spearman
2312
+ value: 91.19454529401669
2313
+ - type: euclidean_pearson
2314
+ value: 90.88727698604517
2315
+ - type: euclidean_spearman
2316
+ value: 90.93184869101279
2317
+ - type: manhattan_pearson
2318
+ value: 90.79591587599141
2319
+ - type: manhattan_spearman
2320
+ value: 90.75783237234161
2321
+ - task:
2322
+ type: STS
2323
+ dataset:
2324
+ type: mteb/sts22-crosslingual-sts
2325
+ name: MTEB STS22 (en)
2326
+ config: en
2327
+ split: test
2328
+ revision: eea2b4fe26a775864c896887d910b76a8098ad3f
2329
+ metrics:
2330
+ - type: cos_sim_pearson
2331
+ value: 71.60579944207497
2332
+ - type: cos_sim_spearman
2333
+ value: 70.08286575049202
2334
+ - type: euclidean_pearson
2335
+ value: 71.83195353568124
2336
+ - type: euclidean_spearman
2337
+ value: 70.3030975376705
2338
+ - type: manhattan_pearson
2339
+ value: 71.80222200714064
2340
+ - type: manhattan_spearman
2341
+ value: 70.04005646739672
2342
+ - task:
2343
+ type: STS
2344
+ dataset:
2345
+ type: mteb/stsbenchmark-sts
2346
+ name: MTEB STSBenchmark
2347
+ config: default
2348
+ split: test
2349
+ revision: b0fddb56ed78048fa8b90373c8a3cfc37b684831
2350
+ metrics:
2351
+ - type: cos_sim_pearson
2352
+ value: 89.65716781275425
2353
+ - type: cos_sim_spearman
2354
+ value: 89.90701888074334
2355
+ - type: euclidean_pearson
2356
+ value: 88.50498754631819
2357
+ - type: euclidean_spearman
2358
+ value: 88.88763469318933
2359
+ - type: manhattan_pearson
2360
+ value: 88.58398429591064
2361
+ - type: manhattan_spearman
2362
+ value: 89.0138386837653
2363
+ - task:
2364
+ type: Reranking
2365
+ dataset:
2366
+ type: mteb/scidocs-reranking
2367
+ name: MTEB SciDocsRR
2368
+ config: default
2369
+ split: test
2370
+ revision: d3c5e1fc0b855ab6097bf1cda04dd73947d7caab
2371
+ metrics:
2372
+ - type: map
2373
+ value: 89.26199160020026
2374
+ - type: mrr
2375
+ value: 96.86981772766087
2376
+ - task:
2377
+ type: Retrieval
2378
+ dataset:
2379
+ type: mteb/scifact
2380
+ name: MTEB SciFact
2381
+ config: default
2382
+ split: test
2383
+ revision: 0228b52cf27578f30900b9e5271d331663a030d7
2384
+ metrics:
2385
+ - type: map_at_1
2386
+ value: 62.827999999999996
2387
+ - type: map_at_10
2388
+ value: 74.028
2389
+ - type: map_at_100
2390
+ value: 74.264
2391
+ - type: map_at_1000
2392
+ value: 74.274
2393
+ - type: map_at_20
2394
+ value: 74.18599999999999
2395
+ - type: map_at_3
2396
+ value: 70.787
2397
+ - type: map_at_5
2398
+ value: 72.87
2399
+ - type: mrr_at_1
2400
+ value: 66.333
2401
+ - type: mrr_at_10
2402
+ value: 74.894
2403
+ - type: mrr_at_100
2404
+ value: 75.09599999999999
2405
+ - type: mrr_at_1000
2406
+ value: 75.105
2407
+ - type: mrr_at_20
2408
+ value: 75.024
2409
+ - type: mrr_at_3
2410
+ value: 72.833
2411
+ - type: mrr_at_5
2412
+ value: 73.917
2413
+ - type: ndcg_at_1
2414
+ value: 66.333
2415
+ - type: ndcg_at_10
2416
+ value: 78.82000000000001
2417
+ - type: ndcg_at_100
2418
+ value: 79.95
2419
+ - type: ndcg_at_1000
2420
+ value: 80.207
2421
+ - type: ndcg_at_20
2422
+ value: 79.324
2423
+ - type: ndcg_at_3
2424
+ value: 73.87899999999999
2425
+ - type: ndcg_at_5
2426
+ value: 76.399
2427
+ - type: precision_at_1
2428
+ value: 66.333
2429
+ - type: precision_at_10
2430
+ value: 10.5
2431
+ - type: precision_at_100
2432
+ value: 1.11
2433
+ - type: precision_at_1000
2434
+ value: 0.11299999999999999
2435
+ - type: precision_at_20
2436
+ value: 5.367
2437
+ - type: precision_at_3
2438
+ value: 29.110999999999997
2439
+ - type: precision_at_5
2440
+ value: 19.333
2441
+ - type: recall_at_1
2442
+ value: 62.827999999999996
2443
+ - type: recall_at_10
2444
+ value: 92.667
2445
+ - type: recall_at_100
2446
+ value: 98.0
2447
+ - type: recall_at_1000
2448
+ value: 100.0
2449
+ - type: recall_at_20
2450
+ value: 94.5
2451
+ - type: recall_at_3
2452
+ value: 79.5
2453
+ - type: recall_at_5
2454
+ value: 85.739
2455
+ - task:
2456
+ type: PairClassification
2457
+ dataset:
2458
+ type: mteb/sprintduplicatequestions-pairclassification
2459
+ name: MTEB SprintDuplicateQuestions
2460
+ config: default
2461
+ split: test
2462
+ revision: d66bd1f72af766a5cc4b0ca5e00c162f89e8cc46
2463
+ metrics:
2464
+ - type: cos_sim_accuracy
2465
+ value: 99.85940594059406
2466
+ - type: cos_sim_ap
2467
+ value: 96.72065839344104
2468
+ - type: cos_sim_f1
2469
+ value: 92.85714285714286
2470
+ - type: cos_sim_precision
2471
+ value: 93.42105263157895
2472
+ - type: cos_sim_recall
2473
+ value: 92.30000000000001
2474
+ - type: dot_accuracy
2475
+ value: 99.84752475247525
2476
+ - type: dot_ap
2477
+ value: 96.41536649209695
2478
+ - type: dot_f1
2479
+ value: 92.24572004028197
2480
+ - type: dot_precision
2481
+ value: 92.90060851926978
2482
+ - type: dot_recall
2483
+ value: 91.60000000000001
2484
+ - type: euclidean_accuracy
2485
+ value: 99.86039603960396
2486
+ - type: euclidean_ap
2487
+ value: 96.63078081708719
2488
+ - type: euclidean_f1
2489
+ value: 92.87518948964124
2490
+ - type: euclidean_precision
2491
+ value: 93.87129724208376
2492
+ - type: euclidean_recall
2493
+ value: 91.9
2494
+ - type: manhattan_accuracy
2495
+ value: 99.86435643564356
2496
+ - type: manhattan_ap
2497
+ value: 96.71272943532432
2498
+ - type: manhattan_f1
2499
+ value: 93.05625950329447
2500
+ - type: manhattan_precision
2501
+ value: 94.34737923946557
2502
+ - type: manhattan_recall
2503
+ value: 91.8
2504
+ - type: max_accuracy
2505
+ value: 99.86435643564356
2506
+ - type: max_ap
2507
+ value: 96.72065839344104
2508
+ - type: max_f1
2509
+ value: 93.05625950329447
2510
+ - task:
2511
+ type: Clustering
2512
+ dataset:
2513
+ type: mteb/stackexchange-clustering
2514
+ name: MTEB StackExchangeClustering
2515
+ config: default
2516
+ split: test
2517
+ revision: 6cbc1f7b2bc0622f2e39d2c77fa502909748c259
2518
+ metrics:
2519
+ - type: v_measure
2520
+ value: 75.95483275621876
2521
+ - task:
2522
+ type: Clustering
2523
+ dataset:
2524
+ type: mteb/stackexchange-clustering-p2p
2525
+ name: MTEB StackExchangeClusteringP2P
2526
+ config: default
2527
+ split: test
2528
+ revision: 815ca46b2622cec33ccafc3735d572c266efdb44
2529
+ metrics:
2530
+ - type: v_measure
2531
+ value: 46.20364113200157
2532
+ - task:
2533
+ type: Reranking
2534
+ dataset:
2535
+ type: mteb/stackoverflowdupquestions-reranking
2536
+ name: MTEB StackOverflowDupQuestions
2537
+ config: default
2538
+ split: test
2539
+ revision: e185fbe320c72810689fc5848eb6114e1ef5ec69
2540
+ metrics:
2541
+ - type: map
2542
+ value: 56.2577092438525
2543
+ - type: mrr
2544
+ value: 57.40251782531194
2545
+ - task:
2546
+ type: Summarization
2547
+ dataset:
2548
+ type: mteb/summeval
2549
+ name: MTEB SummEval
2550
+ config: default
2551
+ split: test
2552
+ revision: cda12ad7615edc362dbf25a00fdd61d3b1eaf93c
2553
+ metrics:
2554
+ - type: cos_sim_pearson
2555
+ value: 30.492357459875645
2556
+ - type: cos_sim_spearman
2557
+ value: 30.868968719156825
2558
+ - type: dot_pearson
2559
+ value: 29.44619482351129
2560
+ - type: dot_spearman
2561
+ value: 31.295984532577215
2562
+ - task:
2563
+ type: Retrieval
2564
+ dataset:
2565
+ type: mteb/trec-covid
2566
+ name: MTEB TRECCOVID
2567
+ config: default
2568
+ split: test
2569
+ revision: bb9466bac8153a0349341eb1b22e06409e78ef4e
2570
+ metrics:
2571
+ - type: map_at_1
2572
+ value: 0.22200000000000003
2573
+ - type: map_at_10
2574
+ value: 1.9290000000000003
2575
+ - type: map_at_100
2576
+ value: 12.435
2577
+ - type: map_at_1000
2578
+ value: 32.352
2579
+ - type: map_at_20
2580
+ value: 3.496
2581
+ - type: map_at_3
2582
+ value: 0.637
2583
+ - type: map_at_5
2584
+ value: 1.016
2585
+ - type: mrr_at_1
2586
+ value: 86.0
2587
+ - type: mrr_at_10
2588
+ value: 92.333
2589
+ - type: mrr_at_100
2590
+ value: 92.333
2591
+ - type: mrr_at_1000
2592
+ value: 92.333
2593
+ - type: mrr_at_20
2594
+ value: 92.333
2595
+ - type: mrr_at_3
2596
+ value: 92.0
2597
+ - type: mrr_at_5
2598
+ value: 92.0
2599
+ - type: ndcg_at_1
2600
+ value: 81.0
2601
+ - type: ndcg_at_10
2602
+ value: 75.32900000000001
2603
+ - type: ndcg_at_100
2604
+ value: 62.756
2605
+ - type: ndcg_at_1000
2606
+ value: 59.232
2607
+ - type: ndcg_at_20
2608
+ value: 73.393
2609
+ - type: ndcg_at_3
2610
+ value: 78.469
2611
+ - type: ndcg_at_5
2612
+ value: 76.953
2613
+ - type: precision_at_1
2614
+ value: 86.0
2615
+ - type: precision_at_10
2616
+ value: 79.4
2617
+ - type: precision_at_100
2618
+ value: 64.94
2619
+ - type: precision_at_1000
2620
+ value: 26.332
2621
+ - type: precision_at_20
2622
+ value: 77.3
2623
+ - type: precision_at_3
2624
+ value: 82.667
2625
+ - type: precision_at_5
2626
+ value: 80.4
2627
+ - type: recall_at_1
2628
+ value: 0.22200000000000003
2629
+ - type: recall_at_10
2630
+ value: 2.113
2631
+ - type: recall_at_100
2632
+ value: 16.02
2633
+ - type: recall_at_1000
2634
+ value: 57.227
2635
+ - type: recall_at_20
2636
+ value: 4.036
2637
+ - type: recall_at_3
2638
+ value: 0.6689999999999999
2639
+ - type: recall_at_5
2640
+ value: 1.076
2641
+ - task:
2642
+ type: Retrieval
2643
+ dataset:
2644
+ type: mteb/touche2020
2645
+ name: MTEB Touche2020
2646
+ config: default
2647
+ split: test
2648
+ revision: a34f9a33db75fa0cbb21bb5cfc3dae8dc8bec93f
2649
+ metrics:
2650
+ - type: map_at_1
2651
+ value: 2.83
2652
+ - type: map_at_10
2653
+ value: 8.981
2654
+ - type: map_at_100
2655
+ value: 14.796000000000001
2656
+ - type: map_at_1000
2657
+ value: 16.451999999999998
2658
+ - type: map_at_20
2659
+ value: 11.361
2660
+ - type: map_at_3
2661
+ value: 5.143
2662
+ - type: map_at_5
2663
+ value: 6.537
2664
+ - type: mrr_at_1
2665
+ value: 36.735
2666
+ - type: mrr_at_10
2667
+ value: 50.99399999999999
2668
+ - type: mrr_at_100
2669
+ value: 51.775000000000006
2670
+ - type: mrr_at_1000
2671
+ value: 51.775000000000006
2672
+ - type: mrr_at_20
2673
+ value: 51.39
2674
+ - type: mrr_at_3
2675
+ value: 47.278999999999996
2676
+ - type: mrr_at_5
2677
+ value: 49.626
2678
+ - type: ndcg_at_1
2679
+ value: 34.694
2680
+ - type: ndcg_at_10
2681
+ value: 24.061
2682
+ - type: ndcg_at_100
2683
+ value: 35.832
2684
+ - type: ndcg_at_1000
2685
+ value: 47.875
2686
+ - type: ndcg_at_20
2687
+ value: 25.022
2688
+ - type: ndcg_at_3
2689
+ value: 27.939999999999998
2690
+ - type: ndcg_at_5
2691
+ value: 25.246000000000002
2692
+ - type: precision_at_1
2693
+ value: 36.735
2694
+ - type: precision_at_10
2695
+ value: 20.204
2696
+ - type: precision_at_100
2697
+ value: 7.224
2698
+ - type: precision_at_1000
2699
+ value: 1.516
2700
+ - type: precision_at_20
2701
+ value: 15.714
2702
+ - type: precision_at_3
2703
+ value: 27.211000000000002
2704
+ - type: precision_at_5
2705
+ value: 23.265
2706
+ - type: recall_at_1
2707
+ value: 2.83
2708
+ - type: recall_at_10
2709
+ value: 14.564
2710
+ - type: recall_at_100
2711
+ value: 45.251000000000005
2712
+ - type: recall_at_1000
2713
+ value: 81.849
2714
+ - type: recall_at_20
2715
+ value: 22.31
2716
+ - type: recall_at_3
2717
+ value: 6.065
2718
+ - type: recall_at_5
2719
+ value: 8.588
2720
+ - task:
2721
+ type: Classification
2722
+ dataset:
2723
+ type: mteb/toxic_conversations_50k
2724
+ name: MTEB ToxicConversationsClassification
2725
+ config: default
2726
+ split: test
2727
+ revision: edfaf9da55d3dd50d43143d90c1ac476895ae6de
2728
+ metrics:
2729
+ - type: accuracy
2730
+ value: 91.17320000000001
2731
+ - type: ap
2732
+ value: 41.18509354980418
2733
+ - type: f1
2734
+ value: 77.77470860794351
2735
+ - task:
2736
+ type: Classification
2737
+ dataset:
2738
+ type: mteb/tweet_sentiment_extraction
2739
+ name: MTEB TweetSentimentExtractionClassification
2740
+ config: default
2741
+ split: test
2742
+ revision: d604517c81ca91fe16a244d1248fc021f9ecee7a
2743
+ metrics:
2744
+ - type: accuracy
2745
+ value: 77.92869269949067
2746
+ - type: f1
2747
+ value: 78.23271267071486
2748
+ - task:
2749
+ type: Clustering
2750
+ dataset:
2751
+ type: mteb/twentynewsgroups-clustering
2752
+ name: MTEB TwentyNewsgroupsClustering
2753
+ config: default
2754
+ split: test
2755
+ revision: 6125ec4e24fa026cec8a478383ee943acfbd5449
2756
+ metrics:
2757
+ - type: v_measure
2758
+ value: 59.59735858830448
2759
+ - task:
2760
+ type: PairClassification
2761
+ dataset:
2762
+ type: mteb/twittersemeval2015-pairclassification
2763
+ name: MTEB TwitterSemEval2015
2764
+ config: default
2765
+ split: test
2766
+ revision: 70970daeab8776df92f5ea462b6173c0b46fd2d1
2767
+ metrics:
2768
+ - type: cos_sim_accuracy
2769
+ value: 87.81069321094355
2770
+ - type: cos_sim_ap
2771
+ value: 79.1522153826438
2772
+ - type: cos_sim_f1
2773
+ value: 72.83363802559415
2774
+ - type: cos_sim_precision
2775
+ value: 67.678369195923
2776
+ - type: cos_sim_recall
2777
+ value: 78.83905013192613
2778
+ - type: dot_accuracy
2779
+ value: 87.369613160875
2780
+ - type: dot_ap
2781
+ value: 78.51617049363121
2782
+ - type: dot_f1
2783
+ value: 71.89735998026153
2784
+ - type: dot_precision
2785
+ value: 67.516218721038
2786
+ - type: dot_recall
2787
+ value: 76.88654353562005
2788
+ - type: euclidean_accuracy
2789
+ value: 87.72724563390356
2790
+ - type: euclidean_ap
2791
+ value: 78.45799796334607
2792
+ - type: euclidean_f1
2793
+ value: 72.7159880834161
2794
+ - type: euclidean_precision
2795
+ value: 68.65916549460853
2796
+ - type: euclidean_recall
2797
+ value: 77.28232189973615
2798
+ - type: manhattan_accuracy
2799
+ value: 87.57823210347499
2800
+ - type: manhattan_ap
2801
+ value: 78.24705251626389
2802
+ - type: manhattan_f1
2803
+ value: 72.34365129500948
2804
+ - type: manhattan_precision
2805
+ value: 69.4060606060606
2806
+ - type: manhattan_recall
2807
+ value: 75.54089709762533
2808
+ - type: max_accuracy
2809
+ value: 87.81069321094355
2810
+ - type: max_ap
2811
+ value: 79.1522153826438
2812
+ - type: max_f1
2813
+ value: 72.83363802559415
2814
+ - task:
2815
+ type: PairClassification
2816
+ dataset:
2817
+ type: mteb/twitterurlcorpus-pairclassification
2818
+ name: MTEB TwitterURLCorpus
2819
+ config: default
2820
+ split: test
2821
+ revision: 8b6510b0b1fa4e4c4f879467980e9be563ec1cdf
2822
+ metrics:
2823
+ - type: cos_sim_accuracy
2824
+ value: 89.76597974152986
2825
+ - type: cos_sim_ap
2826
+ value: 87.15717597277224
2827
+ - type: cos_sim_f1
2828
+ value: 79.71815316150567
2829
+ - type: cos_sim_precision
2830
+ value: 76.89776060671103
2831
+ - type: cos_sim_recall
2832
+ value: 82.75331074838313
2833
+ - type: dot_accuracy
2834
+ value: 89.49237396670159
2835
+ - type: dot_ap
2836
+ value: 86.69824401657353
2837
+ - type: dot_f1
2838
+ value: 79.39796433985418
2839
+ - type: dot_precision
2840
+ value: 74.7316211441772
2841
+ - type: dot_recall
2842
+ value: 84.68586387434554
2843
+ - type: euclidean_accuracy
2844
+ value: 89.65149221872937
2845
+ - type: euclidean_ap
2846
+ value: 86.98932847862545
2847
+ - type: euclidean_f1
2848
+ value: 79.65759212314929
2849
+ - type: euclidean_precision
2850
+ value: 76.17876466868105
2851
+ - type: euclidean_recall
2852
+ value: 83.46935632891899
2853
+ - type: manhattan_accuracy
2854
+ value: 89.63402802033609
2855
+ - type: manhattan_ap
2856
+ value: 86.99550128469285
2857
+ - type: manhattan_f1
2858
+ value: 79.61443655494647
2859
+ - type: manhattan_precision
2860
+ value: 76.23476361586697
2861
+ - type: manhattan_recall
2862
+ value: 83.30766861718509
2863
+ - type: max_accuracy
2864
+ value: 89.76597974152986
2865
+ - type: max_ap
2866
+ value: 87.15717597277224
2867
+ - type: max_f1
2868
+ value: 79.71815316150567
2869
+ ---