sionic commited on
Commit
00e9ff4
1 Parent(s): 36a6738

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +2601 -0
README.md ADDED
@@ -0,0 +1,2601 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - mteb
4
+ - feature-extraction
5
+ - sentence-similarity
6
+ model-index:
7
+ - name: v2
8
+ results:
9
+ - task:
10
+ type: Classification
11
+ dataset:
12
+ type: mteb/amazon_counterfactual
13
+ name: MTEB AmazonCounterfactualClassification (en)
14
+ config: en
15
+ split: test
16
+ revision: e8379541af4e31359cca9fbcf4b00f2671dba205
17
+ metrics:
18
+ - type: accuracy
19
+ value: 76.56716417910448
20
+ - type: ap
21
+ value: 39.864746145463656
22
+ - type: f1
23
+ value: 70.60275403114987
24
+ - task:
25
+ type: Classification
26
+ dataset:
27
+ type: mteb/amazon_polarity
28
+ name: MTEB AmazonPolarityClassification
29
+ config: default
30
+ split: test
31
+ revision: e2d317d38cd51312af73b3d32a06d1a08b442046
32
+ metrics:
33
+ - type: accuracy
34
+ value: 93.46427500000001
35
+ - type: ap
36
+ value: 90.36283359936121
37
+ - type: f1
38
+ value: 93.45329322673612
39
+ - task:
40
+ type: Classification
41
+ dataset:
42
+ type: mteb/amazon_reviews_multi
43
+ name: MTEB AmazonReviewsClassification (en)
44
+ config: en
45
+ split: test
46
+ revision: 1399c76144fd37290681b995c656ef9b2e06e26d
47
+ metrics:
48
+ - type: accuracy
49
+ value: 48.77199999999999
50
+ - type: f1
51
+ value: 48.16695258838576
52
+ - task:
53
+ type: Retrieval
54
+ dataset:
55
+ type: arguana
56
+ name: MTEB ArguAna
57
+ config: default
58
+ split: test
59
+ revision: None
60
+ metrics:
61
+ - type: map_at_1
62
+ value: 40.184999999999995
63
+ - type: map_at_10
64
+ value: 56.114
65
+ - type: map_at_100
66
+ value: 56.676
67
+ - type: map_at_1000
68
+ value: 56.68
69
+ - type: map_at_3
70
+ value: 51.968
71
+ - type: map_at_5
72
+ value: 54.642
73
+ - type: mrr_at_1
74
+ value: 40.896
75
+ - type: mrr_at_10
76
+ value: 56.388000000000005
77
+ - type: mrr_at_100
78
+ value: 56.95099999999999
79
+ - type: mrr_at_1000
80
+ value: 56.95400000000001
81
+ - type: mrr_at_3
82
+ value: 52.251999999999995
83
+ - type: mrr_at_5
84
+ value: 54.879999999999995
85
+ - type: ndcg_at_1
86
+ value: 40.184999999999995
87
+ - type: ndcg_at_10
88
+ value: 64.253
89
+ - type: ndcg_at_100
90
+ value: 66.47
91
+ - type: ndcg_at_1000
92
+ value: 66.549
93
+ - type: ndcg_at_3
94
+ value: 55.945
95
+ - type: ndcg_at_5
96
+ value: 60.742
97
+ - type: precision_at_1
98
+ value: 40.184999999999995
99
+ - type: precision_at_10
100
+ value: 8.982999999999999
101
+ - type: precision_at_100
102
+ value: 0.991
103
+ - type: precision_at_1000
104
+ value: 0.1
105
+ - type: precision_at_3
106
+ value: 22.499
107
+ - type: precision_at_5
108
+ value: 15.817999999999998
109
+ - type: recall_at_1
110
+ value: 40.184999999999995
111
+ - type: recall_at_10
112
+ value: 89.82900000000001
113
+ - type: recall_at_100
114
+ value: 99.075
115
+ - type: recall_at_1000
116
+ value: 99.644
117
+ - type: recall_at_3
118
+ value: 67.496
119
+ - type: recall_at_5
120
+ value: 79.09
121
+ - task:
122
+ type: Clustering
123
+ dataset:
124
+ type: mteb/arxiv-clustering-p2p
125
+ name: MTEB ArxivClusteringP2P
126
+ config: default
127
+ split: test
128
+ revision: a122ad7f3f0291bf49cc6f4d32aa80929df69d5d
129
+ metrics:
130
+ - type: v_measure
131
+ value: 49.64684811204023
132
+ - task:
133
+ type: Clustering
134
+ dataset:
135
+ type: mteb/arxiv-clustering-s2s
136
+ name: MTEB ArxivClusteringS2S
137
+ config: default
138
+ split: test
139
+ revision: f910caf1a6075f7329cdf8c1a6135696f37dbd53
140
+ metrics:
141
+ - type: v_measure
142
+ value: 43.6640710523389
143
+ - task:
144
+ type: Reranking
145
+ dataset:
146
+ type: mteb/askubuntudupquestions-reranking
147
+ name: MTEB AskUbuntuDupQuestions
148
+ config: default
149
+ split: test
150
+ revision: 2000358ca161889fa9c082cb41daa8dcfb161a54
151
+ metrics:
152
+ - type: map
153
+ value: 63.71316367624821
154
+ - type: mrr
155
+ value: 77.02534845886647
156
+ - task:
157
+ type: STS
158
+ dataset:
159
+ type: mteb/biosses-sts
160
+ name: MTEB BIOSSES
161
+ config: default
162
+ split: test
163
+ revision: d3fb88f8f02e40887cd149695127462bbcf29b4a
164
+ metrics:
165
+ - type: cos_sim_pearson
166
+ value: 88.96786300506704
167
+ - type: cos_sim_spearman
168
+ value: 88.08212749295554
169
+ - type: euclidean_pearson
170
+ value: 87.1561534920524
171
+ - type: euclidean_spearman
172
+ value: 88.016463346151
173
+ - type: manhattan_pearson
174
+ value: 87.19359910450564
175
+ - type: manhattan_spearman
176
+ value: 88.10803169765825
177
+ - task:
178
+ type: Classification
179
+ dataset:
180
+ type: mteb/banking77
181
+ name: MTEB Banking77Classification
182
+ config: default
183
+ split: test
184
+ revision: 0fd18e25b25c072e09e0d92ab615fda904d66300
185
+ metrics:
186
+ - type: accuracy
187
+ value: 87.46103896103897
188
+ - type: f1
189
+ value: 87.4315144014101
190
+ - task:
191
+ type: Clustering
192
+ dataset:
193
+ type: mteb/biorxiv-clustering-p2p
194
+ name: MTEB BiorxivClusteringP2P
195
+ config: default
196
+ split: test
197
+ revision: 65b79d1d13f80053f67aca9498d9402c2d9f1f40
198
+ metrics:
199
+ - type: v_measure
200
+ value: 41.03554871732576
201
+ - task:
202
+ type: Clustering
203
+ dataset:
204
+ type: mteb/biorxiv-clustering-s2s
205
+ name: MTEB BiorxivClusteringS2S
206
+ config: default
207
+ split: test
208
+ revision: 258694dd0231531bc1fd9de6ceb52a0853c6d908
209
+ metrics:
210
+ - type: v_measure
211
+ value: 37.974813344124264
212
+ - task:
213
+ type: Retrieval
214
+ dataset:
215
+ type: BeIR/cqadupstack
216
+ name: MTEB CQADupstackAndroidRetrieval
217
+ config: default
218
+ split: test
219
+ revision: None
220
+ metrics:
221
+ - type: map_at_1
222
+ value: 34.174
223
+ - type: map_at_10
224
+ value: 45.728
225
+ - type: map_at_100
226
+ value: 47.266999999999996
227
+ - type: map_at_1000
228
+ value: 47.39
229
+ - type: map_at_3
230
+ value: 41.667
231
+ - type: map_at_5
232
+ value: 44.028
233
+ - type: mrr_at_1
234
+ value: 41.202
235
+ - type: mrr_at_10
236
+ value: 51.49
237
+ - type: mrr_at_100
238
+ value: 52.159
239
+ - type: mrr_at_1000
240
+ value: 52.197
241
+ - type: mrr_at_3
242
+ value: 48.379
243
+ - type: mrr_at_5
244
+ value: 50.331
245
+ - type: ndcg_at_1
246
+ value: 41.202
247
+ - type: ndcg_at_10
248
+ value: 52.38699999999999
249
+ - type: ndcg_at_100
250
+ value: 57.611999999999995
251
+ - type: ndcg_at_1000
252
+ value: 59.318000000000005
253
+ - type: ndcg_at_3
254
+ value: 46.516000000000005
255
+ - type: ndcg_at_5
256
+ value: 49.519000000000005
257
+ - type: precision_at_1
258
+ value: 41.202
259
+ - type: precision_at_10
260
+ value: 9.971
261
+ - type: precision_at_100
262
+ value: 1.5879999999999999
263
+ - type: precision_at_1000
264
+ value: 0.20500000000000002
265
+ - type: precision_at_3
266
+ value: 22.031
267
+ - type: precision_at_5
268
+ value: 16.309
269
+ - type: recall_at_1
270
+ value: 34.174
271
+ - type: recall_at_10
272
+ value: 65.32900000000001
273
+ - type: recall_at_100
274
+ value: 86.64
275
+ - type: recall_at_1000
276
+ value: 97.069
277
+ - type: recall_at_3
278
+ value: 48.607
279
+ - type: recall_at_5
280
+ value: 56.615
281
+ - task:
282
+ type: Retrieval
283
+ dataset:
284
+ type: BeIR/cqadupstack
285
+ name: MTEB CQADupstackEnglishRetrieval
286
+ config: default
287
+ split: test
288
+ revision: None
289
+ metrics:
290
+ - type: map_at_1
291
+ value: 34.73
292
+ - type: map_at_10
293
+ value: 45.617999999999995
294
+ - type: map_at_100
295
+ value: 46.888000000000005
296
+ - type: map_at_1000
297
+ value: 47.016999999999996
298
+ - type: map_at_3
299
+ value: 42.425000000000004
300
+ - type: map_at_5
301
+ value: 44.214999999999996
302
+ - type: mrr_at_1
303
+ value: 43.631
304
+ - type: mrr_at_10
305
+ value: 52.014
306
+ - type: mrr_at_100
307
+ value: 52.6
308
+ - type: mrr_at_1000
309
+ value: 52.637
310
+ - type: mrr_at_3
311
+ value: 50.021
312
+ - type: mrr_at_5
313
+ value: 51.23799999999999
314
+ - type: ndcg_at_1
315
+ value: 43.631
316
+ - type: ndcg_at_10
317
+ value: 51.458000000000006
318
+ - type: ndcg_at_100
319
+ value: 55.61000000000001
320
+ - type: ndcg_at_1000
321
+ value: 57.462
322
+ - type: ndcg_at_3
323
+ value: 47.461
324
+ - type: ndcg_at_5
325
+ value: 49.312
326
+ - type: precision_at_1
327
+ value: 43.631
328
+ - type: precision_at_10
329
+ value: 9.661999999999999
330
+ - type: precision_at_100
331
+ value: 1.5270000000000001
332
+ - type: precision_at_1000
333
+ value: 0.198
334
+ - type: precision_at_3
335
+ value: 22.823999999999998
336
+ - type: precision_at_5
337
+ value: 16.075999999999997
338
+ - type: recall_at_1
339
+ value: 34.73
340
+ - type: recall_at_10
341
+ value: 61.041999999999994
342
+ - type: recall_at_100
343
+ value: 78.658
344
+ - type: recall_at_1000
345
+ value: 90.215
346
+ - type: recall_at_3
347
+ value: 48.952
348
+ - type: recall_at_5
349
+ value: 54.422000000000004
350
+ - task:
351
+ type: Retrieval
352
+ dataset:
353
+ type: BeIR/cqadupstack
354
+ name: MTEB CQADupstackGamingRetrieval
355
+ config: default
356
+ split: test
357
+ revision: None
358
+ metrics:
359
+ - type: map_at_1
360
+ value: 42.047000000000004
361
+ - type: map_at_10
362
+ value: 55.669999999999995
363
+ - type: map_at_100
364
+ value: 56.676
365
+ - type: map_at_1000
366
+ value: 56.728
367
+ - type: map_at_3
368
+ value: 52.275000000000006
369
+ - type: map_at_5
370
+ value: 54.254000000000005
371
+ - type: mrr_at_1
372
+ value: 48.15
373
+ - type: mrr_at_10
374
+ value: 59.036
375
+ - type: mrr_at_100
376
+ value: 59.650999999999996
377
+ - type: mrr_at_1000
378
+ value: 59.675
379
+ - type: mrr_at_3
380
+ value: 56.760999999999996
381
+ - type: mrr_at_5
382
+ value: 58.087
383
+ - type: ndcg_at_1
384
+ value: 48.15
385
+ - type: ndcg_at_10
386
+ value: 61.709
387
+ - type: ndcg_at_100
388
+ value: 65.446
389
+ - type: ndcg_at_1000
390
+ value: 66.388
391
+ - type: ndcg_at_3
392
+ value: 56.333
393
+ - type: ndcg_at_5
394
+ value: 59.028000000000006
395
+ - type: precision_at_1
396
+ value: 48.15
397
+ - type: precision_at_10
398
+ value: 9.893
399
+ - type: precision_at_100
400
+ value: 1.265
401
+ - type: precision_at_1000
402
+ value: 0.13799999999999998
403
+ - type: precision_at_3
404
+ value: 25.266
405
+ - type: precision_at_5
406
+ value: 17.204
407
+ - type: recall_at_1
408
+ value: 42.047000000000004
409
+ - type: recall_at_10
410
+ value: 76.004
411
+ - type: recall_at_100
412
+ value: 91.727
413
+ - type: recall_at_1000
414
+ value: 98.213
415
+ - type: recall_at_3
416
+ value: 61.82
417
+ - type: recall_at_5
418
+ value: 68.42200000000001
419
+ - task:
420
+ type: Retrieval
421
+ dataset:
422
+ type: BeIR/cqadupstack
423
+ name: MTEB CQADupstackGisRetrieval
424
+ config: default
425
+ split: test
426
+ revision: None
427
+ metrics:
428
+ - type: map_at_1
429
+ value: 29.985
430
+ - type: map_at_10
431
+ value: 38.763999999999996
432
+ - type: map_at_100
433
+ value: 39.835
434
+ - type: map_at_1000
435
+ value: 39.900000000000006
436
+ - type: map_at_3
437
+ value: 35.826
438
+ - type: map_at_5
439
+ value: 37.403
440
+ - type: mrr_at_1
441
+ value: 32.202999999999996
442
+ - type: mrr_at_10
443
+ value: 40.94
444
+ - type: mrr_at_100
445
+ value: 41.861
446
+ - type: mrr_at_1000
447
+ value: 41.909
448
+ - type: mrr_at_3
449
+ value: 38.267
450
+ - type: mrr_at_5
451
+ value: 39.748
452
+ - type: ndcg_at_1
453
+ value: 32.202999999999996
454
+ - type: ndcg_at_10
455
+ value: 43.909
456
+ - type: ndcg_at_100
457
+ value: 49.028
458
+ - type: ndcg_at_1000
459
+ value: 50.714999999999996
460
+ - type: ndcg_at_3
461
+ value: 38.239000000000004
462
+ - type: ndcg_at_5
463
+ value: 40.854
464
+ - type: precision_at_1
465
+ value: 32.202999999999996
466
+ - type: precision_at_10
467
+ value: 6.621
468
+ - type: precision_at_100
469
+ value: 0.964
470
+ - type: precision_at_1000
471
+ value: 0.11399999999999999
472
+ - type: precision_at_3
473
+ value: 15.781999999999998
474
+ - type: precision_at_5
475
+ value: 10.96
476
+ - type: recall_at_1
477
+ value: 29.985
478
+ - type: recall_at_10
479
+ value: 57.727
480
+ - type: recall_at_100
481
+ value: 80.833
482
+ - type: recall_at_1000
483
+ value: 93.625
484
+ - type: recall_at_3
485
+ value: 42.396
486
+ - type: recall_at_5
487
+ value: 48.624
488
+ - task:
489
+ type: Retrieval
490
+ dataset:
491
+ type: BeIR/cqadupstack
492
+ name: MTEB CQADupstackMathematicaRetrieval
493
+ config: default
494
+ split: test
495
+ revision: None
496
+ metrics:
497
+ - type: map_at_1
498
+ value: 19.249
499
+ - type: map_at_10
500
+ value: 28.565
501
+ - type: map_at_100
502
+ value: 29.753
503
+ - type: map_at_1000
504
+ value: 29.881
505
+ - type: map_at_3
506
+ value: 25.778000000000002
507
+ - type: map_at_5
508
+ value: 27.21
509
+ - type: mrr_at_1
510
+ value: 23.632
511
+ - type: mrr_at_10
512
+ value: 33.51
513
+ - type: mrr_at_100
514
+ value: 34.372
515
+ - type: mrr_at_1000
516
+ value: 34.443
517
+ - type: mrr_at_3
518
+ value: 30.784
519
+ - type: mrr_at_5
520
+ value: 32.301
521
+ - type: ndcg_at_1
522
+ value: 23.632
523
+ - type: ndcg_at_10
524
+ value: 34.42
525
+ - type: ndcg_at_100
526
+ value: 39.823
527
+ - type: ndcg_at_1000
528
+ value: 42.558
529
+ - type: ndcg_at_3
530
+ value: 29.237000000000002
531
+ - type: ndcg_at_5
532
+ value: 31.465
533
+ - type: precision_at_1
534
+ value: 23.632
535
+ - type: precision_at_10
536
+ value: 6.331
537
+ - type: precision_at_100
538
+ value: 1.042
539
+ - type: precision_at_1000
540
+ value: 0.14100000000000001
541
+ - type: precision_at_3
542
+ value: 14.179
543
+ - type: precision_at_5
544
+ value: 10.299
545
+ - type: recall_at_1
546
+ value: 19.249
547
+ - type: recall_at_10
548
+ value: 47.539
549
+ - type: recall_at_100
550
+ value: 70.612
551
+ - type: recall_at_1000
552
+ value: 89.633
553
+ - type: recall_at_3
554
+ value: 33.082
555
+ - type: recall_at_5
556
+ value: 38.622
557
+ - task:
558
+ type: Retrieval
559
+ dataset:
560
+ type: BeIR/cqadupstack
561
+ name: MTEB CQADupstackPhysicsRetrieval
562
+ config: default
563
+ split: test
564
+ revision: None
565
+ metrics:
566
+ - type: map_at_1
567
+ value: 31.599
568
+ - type: map_at_10
569
+ value: 42.948
570
+ - type: map_at_100
571
+ value: 44.244
572
+ - type: map_at_1000
573
+ value: 44.352000000000004
574
+ - type: map_at_3
575
+ value: 39.352
576
+ - type: map_at_5
577
+ value: 41.397
578
+ - type: mrr_at_1
579
+ value: 38.21
580
+ - type: mrr_at_10
581
+ value: 48.347
582
+ - type: mrr_at_100
583
+ value: 49.132999999999996
584
+ - type: mrr_at_1000
585
+ value: 49.171
586
+ - type: mrr_at_3
587
+ value: 45.653
588
+ - type: mrr_at_5
589
+ value: 47.323
590
+ - type: ndcg_at_1
591
+ value: 38.21
592
+ - type: ndcg_at_10
593
+ value: 49.225
594
+ - type: ndcg_at_100
595
+ value: 54.422000000000004
596
+ - type: ndcg_at_1000
597
+ value: 56.27799999999999
598
+ - type: ndcg_at_3
599
+ value: 43.482
600
+ - type: ndcg_at_5
601
+ value: 46.321
602
+ - type: precision_at_1
603
+ value: 38.21
604
+ - type: precision_at_10
605
+ value: 8.921999999999999
606
+ - type: precision_at_100
607
+ value: 1.333
608
+ - type: precision_at_1000
609
+ value: 0.169
610
+ - type: precision_at_3
611
+ value: 20.372
612
+ - type: precision_at_5
613
+ value: 14.629
614
+ - type: recall_at_1
615
+ value: 31.599
616
+ - type: recall_at_10
617
+ value: 62.364
618
+ - type: recall_at_100
619
+ value: 83.91199999999999
620
+ - type: recall_at_1000
621
+ value: 95.743
622
+ - type: recall_at_3
623
+ value: 46.671
624
+ - type: recall_at_5
625
+ value: 53.772
626
+ - task:
627
+ type: Retrieval
628
+ dataset:
629
+ type: BeIR/cqadupstack
630
+ name: MTEB CQADupstackProgrammersRetrieval
631
+ config: default
632
+ split: test
633
+ revision: None
634
+ metrics:
635
+ - type: map_at_1
636
+ value: 26.641
637
+ - type: map_at_10
638
+ value: 37.604
639
+ - type: map_at_100
640
+ value: 38.897
641
+ - type: map_at_1000
642
+ value: 39.001000000000005
643
+ - type: map_at_3
644
+ value: 34.04
645
+ - type: map_at_5
646
+ value: 35.684
647
+ - type: mrr_at_1
648
+ value: 32.991
649
+ - type: mrr_at_10
650
+ value: 43.029
651
+ - type: mrr_at_100
652
+ value: 43.782
653
+ - type: mrr_at_1000
654
+ value: 43.830999999999996
655
+ - type: mrr_at_3
656
+ value: 40.164
657
+ - type: mrr_at_5
658
+ value: 41.619
659
+ - type: ndcg_at_1
660
+ value: 32.991
661
+ - type: ndcg_at_10
662
+ value: 44.217
663
+ - type: ndcg_at_100
664
+ value: 49.497
665
+ - type: ndcg_at_1000
666
+ value: 51.598
667
+ - type: ndcg_at_3
668
+ value: 38.208999999999996
669
+ - type: ndcg_at_5
670
+ value: 40.444
671
+ - type: precision_at_1
672
+ value: 32.991
673
+ - type: precision_at_10
674
+ value: 8.436
675
+ - type: precision_at_100
676
+ value: 1.279
677
+ - type: precision_at_1000
678
+ value: 0.163
679
+ - type: precision_at_3
680
+ value: 18.379
681
+ - type: precision_at_5
682
+ value: 13.196
683
+ - type: recall_at_1
684
+ value: 26.641
685
+ - type: recall_at_10
686
+ value: 58.50300000000001
687
+ - type: recall_at_100
688
+ value: 81.228
689
+ - type: recall_at_1000
690
+ value: 95.345
691
+ - type: recall_at_3
692
+ value: 41.6
693
+ - type: recall_at_5
694
+ value: 47.425
695
+ - task:
696
+ type: Retrieval
697
+ dataset:
698
+ type: BeIR/cqadupstack
699
+ name: MTEB CQADupstackRetrieval
700
+ config: default
701
+ split: test
702
+ revision: None
703
+ metrics:
704
+ - type: map_at_1
705
+ value: 28.678083333333333
706
+ - type: map_at_10
707
+ value: 38.63366666666666
708
+ - type: map_at_100
709
+ value: 39.84708333333333
710
+ - type: map_at_1000
711
+ value: 39.959583333333335
712
+ - type: map_at_3
713
+ value: 35.49
714
+ - type: map_at_5
715
+ value: 37.23125
716
+ - type: mrr_at_1
717
+ value: 33.813916666666664
718
+ - type: mrr_at_10
719
+ value: 42.955500000000015
720
+ - type: mrr_at_100
721
+ value: 43.75541666666667
722
+ - type: mrr_at_1000
723
+ value: 43.80616666666666
724
+ - type: mrr_at_3
725
+ value: 40.40191666666667
726
+ - type: mrr_at_5
727
+ value: 41.88358333333333
728
+ - type: ndcg_at_1
729
+ value: 33.813916666666664
730
+ - type: ndcg_at_10
731
+ value: 44.361666666666665
732
+ - type: ndcg_at_100
733
+ value: 49.37991666666667
734
+ - type: ndcg_at_1000
735
+ value: 51.432583333333326
736
+ - type: ndcg_at_3
737
+ value: 39.12949999999999
738
+ - type: ndcg_at_5
739
+ value: 41.60183333333333
740
+ - type: precision_at_1
741
+ value: 33.813916666666664
742
+ - type: precision_at_10
743
+ value: 7.759250000000002
744
+ - type: precision_at_100
745
+ value: 1.2108333333333332
746
+ - type: precision_at_1000
747
+ value: 0.158
748
+ - type: precision_at_3
749
+ value: 17.90716666666667
750
+ - type: precision_at_5
751
+ value: 12.765333333333334
752
+ - type: recall_at_1
753
+ value: 28.678083333333333
754
+ - type: recall_at_10
755
+ value: 56.92716666666667
756
+ - type: recall_at_100
757
+ value: 78.74991666666668
758
+ - type: recall_at_1000
759
+ value: 92.73875000000001
760
+ - type: recall_at_3
761
+ value: 42.459916666666665
762
+ - type: recall_at_5
763
+ value: 48.76258333333333
764
+ - task:
765
+ type: Retrieval
766
+ dataset:
767
+ type: BeIR/cqadupstack
768
+ name: MTEB CQADupstackStatsRetrieval
769
+ config: default
770
+ split: test
771
+ revision: None
772
+ metrics:
773
+ - type: map_at_1
774
+ value: 27.282
775
+ - type: map_at_10
776
+ value: 34.458
777
+ - type: map_at_100
778
+ value: 35.44
779
+ - type: map_at_1000
780
+ value: 35.536
781
+ - type: map_at_3
782
+ value: 31.912000000000003
783
+ - type: map_at_5
784
+ value: 33.495000000000005
785
+ - type: mrr_at_1
786
+ value: 30.675
787
+ - type: mrr_at_10
788
+ value: 37.563
789
+ - type: mrr_at_100
790
+ value: 38.374
791
+ - type: mrr_at_1000
792
+ value: 38.444
793
+ - type: mrr_at_3
794
+ value: 35.276
795
+ - type: mrr_at_5
796
+ value: 36.718
797
+ - type: ndcg_at_1
798
+ value: 30.675
799
+ - type: ndcg_at_10
800
+ value: 38.838
801
+ - type: ndcg_at_100
802
+ value: 43.527
803
+ - type: ndcg_at_1000
804
+ value: 45.891
805
+ - type: ndcg_at_3
806
+ value: 34.314
807
+ - type: ndcg_at_5
808
+ value: 36.789
809
+ - type: precision_at_1
810
+ value: 30.675
811
+ - type: precision_at_10
812
+ value: 6.012
813
+ - type: precision_at_100
814
+ value: 0.903
815
+ - type: precision_at_1000
816
+ value: 0.117
817
+ - type: precision_at_3
818
+ value: 14.571000000000002
819
+ - type: precision_at_5
820
+ value: 10.306999999999999
821
+ - type: recall_at_1
822
+ value: 27.282
823
+ - type: recall_at_10
824
+ value: 49.198
825
+ - type: recall_at_100
826
+ value: 70.489
827
+ - type: recall_at_1000
828
+ value: 87.902
829
+ - type: recall_at_3
830
+ value: 36.966
831
+ - type: recall_at_5
832
+ value: 43.079
833
+ - task:
834
+ type: Retrieval
835
+ dataset:
836
+ type: BeIR/cqadupstack
837
+ name: MTEB CQADupstackTexRetrieval
838
+ config: default
839
+ split: test
840
+ revision: None
841
+ metrics:
842
+ - type: map_at_1
843
+ value: 19.839000000000002
844
+ - type: map_at_10
845
+ value: 27.68
846
+ - type: map_at_100
847
+ value: 28.851
848
+ - type: map_at_1000
849
+ value: 28.977999999999998
850
+ - type: map_at_3
851
+ value: 25.062
852
+ - type: map_at_5
853
+ value: 26.389000000000003
854
+ - type: mrr_at_1
855
+ value: 23.813000000000002
856
+ - type: mrr_at_10
857
+ value: 31.628
858
+ - type: mrr_at_100
859
+ value: 32.58
860
+ - type: mrr_at_1000
861
+ value: 32.655
862
+ - type: mrr_at_3
863
+ value: 29.29
864
+ - type: mrr_at_5
865
+ value: 30.551000000000002
866
+ - type: ndcg_at_1
867
+ value: 23.813000000000002
868
+ - type: ndcg_at_10
869
+ value: 32.751000000000005
870
+ - type: ndcg_at_100
871
+ value: 38.218
872
+ - type: ndcg_at_1000
873
+ value: 40.979
874
+ - type: ndcg_at_3
875
+ value: 28.043000000000003
876
+ - type: ndcg_at_5
877
+ value: 30.043
878
+ - type: precision_at_1
879
+ value: 23.813000000000002
880
+ - type: precision_at_10
881
+ value: 5.936
882
+ - type: precision_at_100
883
+ value: 1.016
884
+ - type: precision_at_1000
885
+ value: 0.14400000000000002
886
+ - type: precision_at_3
887
+ value: 13.145000000000001
888
+ - type: precision_at_5
889
+ value: 9.443
890
+ - type: recall_at_1
891
+ value: 19.839000000000002
892
+ - type: recall_at_10
893
+ value: 44.072
894
+ - type: recall_at_100
895
+ value: 68.406
896
+ - type: recall_at_1000
897
+ value: 87.749
898
+ - type: recall_at_3
899
+ value: 30.906
900
+ - type: recall_at_5
901
+ value: 36.081
902
+ - task:
903
+ type: Retrieval
904
+ dataset:
905
+ type: BeIR/cqadupstack
906
+ name: MTEB CQADupstackUnixRetrieval
907
+ config: default
908
+ split: test
909
+ revision: None
910
+ metrics:
911
+ - type: map_at_1
912
+ value: 28.195999999999998
913
+ - type: map_at_10
914
+ value: 38.345
915
+ - type: map_at_100
916
+ value: 39.561
917
+ - type: map_at_1000
918
+ value: 39.65
919
+ - type: map_at_3
920
+ value: 35.382999999999996
921
+ - type: map_at_5
922
+ value: 37.023
923
+ - type: mrr_at_1
924
+ value: 33.022
925
+ - type: mrr_at_10
926
+ value: 42.504
927
+ - type: mrr_at_100
928
+ value: 43.376
929
+ - type: mrr_at_1000
930
+ value: 43.427
931
+ - type: mrr_at_3
932
+ value: 40.050000000000004
933
+ - type: mrr_at_5
934
+ value: 41.421
935
+ - type: ndcg_at_1
936
+ value: 33.022
937
+ - type: ndcg_at_10
938
+ value: 43.997
939
+ - type: ndcg_at_100
940
+ value: 49.370000000000005
941
+ - type: ndcg_at_1000
942
+ value: 51.38399999999999
943
+ - type: ndcg_at_3
944
+ value: 38.802
945
+ - type: ndcg_at_5
946
+ value: 41.209
947
+ - type: precision_at_1
948
+ value: 33.022
949
+ - type: precision_at_10
950
+ value: 7.351000000000001
951
+ - type: precision_at_100
952
+ value: 1.1440000000000001
953
+ - type: precision_at_1000
954
+ value: 0.14200000000000002
955
+ - type: precision_at_3
956
+ value: 17.724
957
+ - type: precision_at_5
958
+ value: 12.443999999999999
959
+ - type: recall_at_1
960
+ value: 28.195999999999998
961
+ - type: recall_at_10
962
+ value: 57.011
963
+ - type: recall_at_100
964
+ value: 79.922
965
+ - type: recall_at_1000
966
+ value: 93.952
967
+ - type: recall_at_3
968
+ value: 42.857
969
+ - type: recall_at_5
970
+ value: 48.916
971
+ - task:
972
+ type: Retrieval
973
+ dataset:
974
+ type: BeIR/cqadupstack
975
+ name: MTEB CQADupstackWebmastersRetrieval
976
+ config: default
977
+ split: test
978
+ revision: None
979
+ metrics:
980
+ - type: map_at_1
981
+ value: 25.768
982
+ - type: map_at_10
983
+ value: 35.118
984
+ - type: map_at_100
985
+ value: 36.817
986
+ - type: map_at_1000
987
+ value: 37.037
988
+ - type: map_at_3
989
+ value: 31.997999999999998
990
+ - type: map_at_5
991
+ value: 33.697
992
+ - type: mrr_at_1
993
+ value: 31.621
994
+ - type: mrr_at_10
995
+ value: 40.228
996
+ - type: mrr_at_100
997
+ value: 41.239
998
+ - type: mrr_at_1000
999
+ value: 41.277
1000
+ - type: mrr_at_3
1001
+ value: 37.614999999999995
1002
+ - type: mrr_at_5
1003
+ value: 39.058
1004
+ - type: ndcg_at_1
1005
+ value: 31.621
1006
+ - type: ndcg_at_10
1007
+ value: 41.347
1008
+ - type: ndcg_at_100
1009
+ value: 47.620000000000005
1010
+ - type: ndcg_at_1000
1011
+ value: 49.759
1012
+ - type: ndcg_at_3
1013
+ value: 36.361
1014
+ - type: ndcg_at_5
1015
+ value: 38.635000000000005
1016
+ - type: precision_at_1
1017
+ value: 31.621
1018
+ - type: precision_at_10
1019
+ value: 8.024000000000001
1020
+ - type: precision_at_100
1021
+ value: 1.595
1022
+ - type: precision_at_1000
1023
+ value: 0.244
1024
+ - type: precision_at_3
1025
+ value: 16.996
1026
+ - type: precision_at_5
1027
+ value: 12.372
1028
+ - type: recall_at_1
1029
+ value: 25.768
1030
+ - type: recall_at_10
1031
+ value: 53.02
1032
+ - type: recall_at_100
1033
+ value: 81.329
1034
+ - type: recall_at_1000
1035
+ value: 94.025
1036
+ - type: recall_at_3
1037
+ value: 38.884
1038
+ - type: recall_at_5
1039
+ value: 45.057
1040
+ - task:
1041
+ type: Retrieval
1042
+ dataset:
1043
+ type: BeIR/cqadupstack
1044
+ name: MTEB CQADupstackWordpressRetrieval
1045
+ config: default
1046
+ split: test
1047
+ revision: None
1048
+ metrics:
1049
+ - type: map_at_1
1050
+ value: 24.627
1051
+ - type: map_at_10
1052
+ value: 33.106
1053
+ - type: map_at_100
1054
+ value: 33.936
1055
+ - type: map_at_1000
1056
+ value: 34.044999999999995
1057
+ - type: map_at_3
1058
+ value: 30.162
1059
+ - type: map_at_5
1060
+ value: 31.979999999999997
1061
+ - type: mrr_at_1
1062
+ value: 26.617
1063
+ - type: mrr_at_10
1064
+ value: 35.177
1065
+ - type: mrr_at_100
1066
+ value: 35.937999999999995
1067
+ - type: mrr_at_1000
1068
+ value: 36.008
1069
+ - type: mrr_at_3
1070
+ value: 32.562999999999995
1071
+ - type: mrr_at_5
1072
+ value: 34.208
1073
+ - type: ndcg_at_1
1074
+ value: 26.617
1075
+ - type: ndcg_at_10
1076
+ value: 38.082
1077
+ - type: ndcg_at_100
1078
+ value: 42.386
1079
+ - type: ndcg_at_1000
1080
+ value: 44.861000000000004
1081
+ - type: ndcg_at_3
1082
+ value: 32.557
1083
+ - type: ndcg_at_5
1084
+ value: 35.603
1085
+ - type: precision_at_1
1086
+ value: 26.617
1087
+ - type: precision_at_10
1088
+ value: 5.952
1089
+ - type: precision_at_100
1090
+ value: 0.874
1091
+ - type: precision_at_1000
1092
+ value: 0.121
1093
+ - type: precision_at_3
1094
+ value: 13.617
1095
+ - type: precision_at_5
1096
+ value: 9.945
1097
+ - type: recall_at_1
1098
+ value: 24.627
1099
+ - type: recall_at_10
1100
+ value: 51.317
1101
+ - type: recall_at_100
1102
+ value: 71.243
1103
+ - type: recall_at_1000
1104
+ value: 89.39399999999999
1105
+ - type: recall_at_3
1106
+ value: 36.778
1107
+ - type: recall_at_5
1108
+ value: 44.116
1109
+ - task:
1110
+ type: Retrieval
1111
+ dataset:
1112
+ type: climate-fever
1113
+ name: MTEB ClimateFEVER
1114
+ config: default
1115
+ split: test
1116
+ revision: None
1117
+ metrics:
1118
+ - type: map_at_1
1119
+ value: 16.631
1120
+ - type: map_at_10
1121
+ value: 28.069
1122
+ - type: map_at_100
1123
+ value: 30.130000000000003
1124
+ - type: map_at_1000
1125
+ value: 30.318
1126
+ - type: map_at_3
1127
+ value: 23.430999999999997
1128
+ - type: map_at_5
1129
+ value: 25.929000000000002
1130
+ - type: mrr_at_1
1131
+ value: 37.264
1132
+ - type: mrr_at_10
1133
+ value: 49.608999999999995
1134
+ - type: mrr_at_100
1135
+ value: 50.349
1136
+ - type: mrr_at_1000
1137
+ value: 50.373000000000005
1138
+ - type: mrr_at_3
1139
+ value: 46.515
1140
+ - type: mrr_at_5
1141
+ value: 48.41
1142
+ - type: ndcg_at_1
1143
+ value: 37.264
1144
+ - type: ndcg_at_10
1145
+ value: 37.688
1146
+ - type: ndcg_at_100
1147
+ value: 45.101
1148
+ - type: ndcg_at_1000
1149
+ value: 48.19
1150
+ - type: ndcg_at_3
1151
+ value: 31.471
1152
+ - type: ndcg_at_5
1153
+ value: 33.719
1154
+ - type: precision_at_1
1155
+ value: 37.264
1156
+ - type: precision_at_10
1157
+ value: 11.616
1158
+ - type: precision_at_100
1159
+ value: 1.9619999999999997
1160
+ - type: precision_at_1000
1161
+ value: 0.255
1162
+ - type: precision_at_3
1163
+ value: 23.214000000000002
1164
+ - type: precision_at_5
1165
+ value: 17.824
1166
+ - type: recall_at_1
1167
+ value: 16.631
1168
+ - type: recall_at_10
1169
+ value: 43.516
1170
+ - type: recall_at_100
1171
+ value: 68.681
1172
+ - type: recall_at_1000
1173
+ value: 85.751
1174
+ - type: recall_at_3
1175
+ value: 28.199
1176
+ - type: recall_at_5
1177
+ value: 34.826
1178
+ - task:
1179
+ type: Retrieval
1180
+ dataset:
1181
+ type: dbpedia-entity
1182
+ name: MTEB DBPedia
1183
+ config: default
1184
+ split: test
1185
+ revision: None
1186
+ metrics:
1187
+ - type: map_at_1
1188
+ value: 9.971
1189
+ - type: map_at_10
1190
+ value: 22.274
1191
+ - type: map_at_100
1192
+ value: 32.61
1193
+ - type: map_at_1000
1194
+ value: 34.422000000000004
1195
+ - type: map_at_3
1196
+ value: 15.473999999999998
1197
+ - type: map_at_5
1198
+ value: 18.412
1199
+ - type: mrr_at_1
1200
+ value: 72.25
1201
+ - type: mrr_at_10
1202
+ value: 79.945
1203
+ - type: mrr_at_100
1204
+ value: 80.192
1205
+ - type: mrr_at_1000
1206
+ value: 80.199
1207
+ - type: mrr_at_3
1208
+ value: 78.667
1209
+ - type: mrr_at_5
1210
+ value: 79.49199999999999
1211
+ - type: ndcg_at_1
1212
+ value: 59.75
1213
+ - type: ndcg_at_10
1214
+ value: 45.689
1215
+ - type: ndcg_at_100
1216
+ value: 51.687000000000005
1217
+ - type: ndcg_at_1000
1218
+ value: 58.904999999999994
1219
+ - type: ndcg_at_3
1220
+ value: 49.675999999999995
1221
+ - type: ndcg_at_5
1222
+ value: 47.419
1223
+ - type: precision_at_1
1224
+ value: 72.25
1225
+ - type: precision_at_10
1226
+ value: 37.05
1227
+ - type: precision_at_100
1228
+ value: 12.183
1229
+ - type: precision_at_1000
1230
+ value: 2.2929999999999997
1231
+ - type: precision_at_3
1232
+ value: 53.417
1233
+ - type: precision_at_5
1234
+ value: 46.150000000000006
1235
+ - type: recall_at_1
1236
+ value: 9.971
1237
+ - type: recall_at_10
1238
+ value: 27.932000000000002
1239
+ - type: recall_at_100
1240
+ value: 58.85399999999999
1241
+ - type: recall_at_1000
1242
+ value: 81.728
1243
+ - type: recall_at_3
1244
+ value: 16.619999999999997
1245
+ - type: recall_at_5
1246
+ value: 21.082
1247
+ - task:
1248
+ type: Classification
1249
+ dataset:
1250
+ type: mteb/emotion
1251
+ name: MTEB EmotionClassification
1252
+ config: default
1253
+ split: test
1254
+ revision: 4f58c6b202a23cf9a4da393831edf4f9183cad37
1255
+ metrics:
1256
+ - type: accuracy
1257
+ value: 52.83499999999999
1258
+ - type: f1
1259
+ value: 47.754076079187044
1260
+ - task:
1261
+ type: Retrieval
1262
+ dataset:
1263
+ type: fever
1264
+ name: MTEB FEVER
1265
+ config: default
1266
+ split: test
1267
+ revision: None
1268
+ metrics:
1269
+ - type: map_at_1
1270
+ value: 79.783
1271
+ - type: map_at_10
1272
+ value: 87.224
1273
+ - type: map_at_100
1274
+ value: 87.401
1275
+ - type: map_at_1000
1276
+ value: 87.413
1277
+ - type: map_at_3
1278
+ value: 86.29
1279
+ - type: map_at_5
1280
+ value: 86.896
1281
+ - type: mrr_at_1
1282
+ value: 86.09400000000001
1283
+ - type: mrr_at_10
1284
+ value: 91.789
1285
+ - type: mrr_at_100
1286
+ value: 91.814
1287
+ - type: mrr_at_1000
1288
+ value: 91.815
1289
+ - type: mrr_at_3
1290
+ value: 91.39399999999999
1291
+ - type: mrr_at_5
1292
+ value: 91.684
1293
+ - type: ndcg_at_1
1294
+ value: 86.09400000000001
1295
+ - type: ndcg_at_10
1296
+ value: 90.36999999999999
1297
+ - type: ndcg_at_100
1298
+ value: 90.95299999999999
1299
+ - type: ndcg_at_1000
1300
+ value: 91.13799999999999
1301
+ - type: ndcg_at_3
1302
+ value: 89.13799999999999
1303
+ - type: ndcg_at_5
1304
+ value: 89.845
1305
+ - type: precision_at_1
1306
+ value: 86.09400000000001
1307
+ - type: precision_at_10
1308
+ value: 10.671
1309
+ - type: precision_at_100
1310
+ value: 1.123
1311
+ - type: precision_at_1000
1312
+ value: 0.11499999999999999
1313
+ - type: precision_at_3
1314
+ value: 33.698
1315
+ - type: precision_at_5
1316
+ value: 20.788999999999998
1317
+ - type: recall_at_1
1318
+ value: 79.783
1319
+ - type: recall_at_10
1320
+ value: 95.50999999999999
1321
+ - type: recall_at_100
1322
+ value: 97.68900000000001
1323
+ - type: recall_at_1000
1324
+ value: 98.79400000000001
1325
+ - type: recall_at_3
1326
+ value: 92.14099999999999
1327
+ - type: recall_at_5
1328
+ value: 94.0
1329
+ - task:
1330
+ type: Retrieval
1331
+ dataset:
1332
+ type: fiqa
1333
+ name: MTEB FiQA2018
1334
+ config: default
1335
+ split: test
1336
+ revision: None
1337
+ metrics:
1338
+ - type: map_at_1
1339
+ value: 23.526
1340
+ - type: map_at_10
1341
+ value: 38.135999999999996
1342
+ - type: map_at_100
1343
+ value: 40.221000000000004
1344
+ - type: map_at_1000
1345
+ value: 40.394000000000005
1346
+ - type: map_at_3
1347
+ value: 33.548
1348
+ - type: map_at_5
1349
+ value: 35.975
1350
+ - type: mrr_at_1
1351
+ value: 47.068
1352
+ - type: mrr_at_10
1353
+ value: 55.224
1354
+ - type: mrr_at_100
1355
+ value: 56.038
1356
+ - type: mrr_at_1000
1357
+ value: 56.066
1358
+ - type: mrr_at_3
1359
+ value: 53.00899999999999
1360
+ - type: mrr_at_5
1361
+ value: 54.306
1362
+ - type: ndcg_at_1
1363
+ value: 47.068
1364
+ - type: ndcg_at_10
1365
+ value: 46.399
1366
+ - type: ndcg_at_100
1367
+ value: 53.312000000000005
1368
+ - type: ndcg_at_1000
1369
+ value: 55.946
1370
+ - type: ndcg_at_3
1371
+ value: 42.954
1372
+ - type: ndcg_at_5
1373
+ value: 43.765
1374
+ - type: precision_at_1
1375
+ value: 47.068
1376
+ - type: precision_at_10
1377
+ value: 12.824
1378
+ - type: precision_at_100
1379
+ value: 1.986
1380
+ - type: precision_at_1000
1381
+ value: 0.246
1382
+ - type: precision_at_3
1383
+ value: 28.807
1384
+ - type: precision_at_5
1385
+ value: 20.772
1386
+ - type: recall_at_1
1387
+ value: 23.526
1388
+ - type: recall_at_10
1389
+ value: 53.242999999999995
1390
+ - type: recall_at_100
1391
+ value: 78.309
1392
+ - type: recall_at_1000
1393
+ value: 93.92099999999999
1394
+ - type: recall_at_3
1395
+ value: 38.716
1396
+ - type: recall_at_5
1397
+ value: 44.921
1398
+ - task:
1399
+ type: Retrieval
1400
+ dataset:
1401
+ type: hotpotqa
1402
+ name: MTEB HotpotQA
1403
+ config: default
1404
+ split: test
1405
+ revision: None
1406
+ metrics:
1407
+ - type: map_at_1
1408
+ value: 41.641
1409
+ - type: map_at_10
1410
+ value: 67.24
1411
+ - type: map_at_100
1412
+ value: 68.108
1413
+ - type: map_at_1000
1414
+ value: 68.157
1415
+ - type: map_at_3
1416
+ value: 63.834999999999994
1417
+ - type: map_at_5
1418
+ value: 65.995
1419
+ - type: mrr_at_1
1420
+ value: 83.282
1421
+ - type: mrr_at_10
1422
+ value: 88.22
1423
+ - type: mrr_at_100
1424
+ value: 88.35499999999999
1425
+ - type: mrr_at_1000
1426
+ value: 88.358
1427
+ - type: mrr_at_3
1428
+ value: 87.571
1429
+ - type: mrr_at_5
1430
+ value: 88.01299999999999
1431
+ - type: ndcg_at_1
1432
+ value: 83.282
1433
+ - type: ndcg_at_10
1434
+ value: 75.066
1435
+ - type: ndcg_at_100
1436
+ value: 77.952
1437
+ - type: ndcg_at_1000
1438
+ value: 78.878
1439
+ - type: ndcg_at_3
1440
+ value: 70.482
1441
+ - type: ndcg_at_5
1442
+ value: 73.098
1443
+ - type: precision_at_1
1444
+ value: 83.282
1445
+ - type: precision_at_10
1446
+ value: 15.608
1447
+ - type: precision_at_100
1448
+ value: 1.7840000000000003
1449
+ - type: precision_at_1000
1450
+ value: 0.191
1451
+ - type: precision_at_3
1452
+ value: 45.324999999999996
1453
+ - type: precision_at_5
1454
+ value: 29.256
1455
+ - type: recall_at_1
1456
+ value: 41.641
1457
+ - type: recall_at_10
1458
+ value: 78.042
1459
+ - type: recall_at_100
1460
+ value: 89.223
1461
+ - type: recall_at_1000
1462
+ value: 95.341
1463
+ - type: recall_at_3
1464
+ value: 67.988
1465
+ - type: recall_at_5
1466
+ value: 73.14
1467
+ - task:
1468
+ type: Classification
1469
+ dataset:
1470
+ type: mteb/imdb
1471
+ name: MTEB ImdbClassification
1472
+ config: default
1473
+ split: test
1474
+ revision: 3d86128a09e091d6018b6d26cad27f2739fc2db7
1475
+ metrics:
1476
+ - type: accuracy
1477
+ value: 93.50520000000002
1478
+ - type: ap
1479
+ value: 90.36560251927821
1480
+ - type: f1
1481
+ value: 93.50064413170799
1482
+ - task:
1483
+ type: Retrieval
1484
+ dataset:
1485
+ type: msmarco
1486
+ name: MTEB MSMARCO
1487
+ config: default
1488
+ split: dev
1489
+ revision: None
1490
+ metrics:
1491
+ - type: map_at_1
1492
+ value: 23.355999999999998
1493
+ - type: map_at_10
1494
+ value: 36.082
1495
+ - type: map_at_100
1496
+ value: 37.239
1497
+ - type: map_at_1000
1498
+ value: 37.285000000000004
1499
+ - type: map_at_3
1500
+ value: 32.16
1501
+ - type: map_at_5
1502
+ value: 34.469
1503
+ - type: mrr_at_1
1504
+ value: 23.968
1505
+ - type: mrr_at_10
1506
+ value: 36.708
1507
+ - type: mrr_at_100
1508
+ value: 37.795
1509
+ - type: mrr_at_1000
1510
+ value: 37.836
1511
+ - type: mrr_at_3
1512
+ value: 32.865
1513
+ - type: mrr_at_5
1514
+ value: 35.154
1515
+ - type: ndcg_at_1
1516
+ value: 23.968
1517
+ - type: ndcg_at_10
1518
+ value: 43.152
1519
+ - type: ndcg_at_100
1520
+ value: 48.615
1521
+ - type: ndcg_at_1000
1522
+ value: 49.714000000000006
1523
+ - type: ndcg_at_3
1524
+ value: 35.208
1525
+ - type: ndcg_at_5
1526
+ value: 39.342
1527
+ - type: precision_at_1
1528
+ value: 23.968
1529
+ - type: precision_at_10
1530
+ value: 6.784
1531
+ - type: precision_at_100
1532
+ value: 0.951
1533
+ - type: precision_at_1000
1534
+ value: 0.104
1535
+ - type: precision_at_3
1536
+ value: 14.995
1537
+ - type: precision_at_5
1538
+ value: 11.092
1539
+ - type: recall_at_1
1540
+ value: 23.355999999999998
1541
+ - type: recall_at_10
1542
+ value: 64.828
1543
+ - type: recall_at_100
1544
+ value: 89.888
1545
+ - type: recall_at_1000
1546
+ value: 98.181
1547
+ - type: recall_at_3
1548
+ value: 43.336000000000006
1549
+ - type: recall_at_5
1550
+ value: 53.274
1551
+ - task:
1552
+ type: Classification
1553
+ dataset:
1554
+ type: mteb/mtop_domain
1555
+ name: MTEB MTOPDomainClassification (en)
1556
+ config: en
1557
+ split: test
1558
+ revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf
1559
+ metrics:
1560
+ - type: accuracy
1561
+ value: 94.97948016415869
1562
+ - type: f1
1563
+ value: 94.77285510790911
1564
+ - task:
1565
+ type: Classification
1566
+ dataset:
1567
+ type: mteb/mtop_intent
1568
+ name: MTEB MTOPIntentClassification (en)
1569
+ config: en
1570
+ split: test
1571
+ revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba
1572
+ metrics:
1573
+ - type: accuracy
1574
+ value: 78.49749202006383
1575
+ - type: f1
1576
+ value: 59.36772995632707
1577
+ - task:
1578
+ type: Classification
1579
+ dataset:
1580
+ type: mteb/amazon_massive_intent
1581
+ name: MTEB MassiveIntentClassification (en)
1582
+ config: en
1583
+ split: test
1584
+ revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed7
1585
+ metrics:
1586
+ - type: accuracy
1587
+ value: 77.64290517821117
1588
+ - type: f1
1589
+ value: 75.33296771580456
1590
+ - task:
1591
+ type: Classification
1592
+ dataset:
1593
+ type: mteb/amazon_massive_scenario
1594
+ name: MTEB MassiveScenarioClassification (en)
1595
+ config: en
1596
+ split: test
1597
+ revision: 7d571f92784cd94a019292a1f45445077d0ef634
1598
+ metrics:
1599
+ - type: accuracy
1600
+ value: 80.76664425016811
1601
+ - type: f1
1602
+ value: 80.79147962348141
1603
+ - task:
1604
+ type: Clustering
1605
+ dataset:
1606
+ type: mteb/medrxiv-clustering-p2p
1607
+ name: MTEB MedrxivClusteringP2P
1608
+ config: default
1609
+ split: test
1610
+ revision: e7a26af6f3ae46b30dde8737f02c07b1505bcc73
1611
+ metrics:
1612
+ - type: v_measure
1613
+ value: 35.158637354708034
1614
+ - task:
1615
+ type: Clustering
1616
+ dataset:
1617
+ type: mteb/medrxiv-clustering-s2s
1618
+ name: MTEB MedrxivClusteringS2S
1619
+ config: default
1620
+ split: test
1621
+ revision: 35191c8c0dca72d8ff3efcd72aa802307d469663
1622
+ metrics:
1623
+ - type: v_measure
1624
+ value: 32.39319499403552
1625
+ - task:
1626
+ type: Reranking
1627
+ dataset:
1628
+ type: mteb/mind_small
1629
+ name: MTEB MindSmallReranking
1630
+ config: default
1631
+ split: test
1632
+ revision: 3bdac13927fdc888b903db93b2ffdbd90b295a69
1633
+ metrics:
1634
+ - type: map
1635
+ value: 32.19460802526735
1636
+ - type: mrr
1637
+ value: 33.39458959690712
1638
+ - task:
1639
+ type: Retrieval
1640
+ dataset:
1641
+ type: nfcorpus
1642
+ name: MTEB NFCorpus
1643
+ config: default
1644
+ split: test
1645
+ revision: None
1646
+ metrics:
1647
+ - type: map_at_1
1648
+ value: 7.225
1649
+ - type: map_at_10
1650
+ value: 15.609
1651
+ - type: map_at_100
1652
+ value: 20.067
1653
+ - type: map_at_1000
1654
+ value: 21.709999999999997
1655
+ - type: map_at_3
1656
+ value: 11.518
1657
+ - type: map_at_5
1658
+ value: 13.469999999999999
1659
+ - type: mrr_at_1
1660
+ value: 50.15500000000001
1661
+ - type: mrr_at_10
1662
+ value: 58.711
1663
+ - type: mrr_at_100
1664
+ value: 59.333000000000006
1665
+ - type: mrr_at_1000
1666
+ value: 59.362
1667
+ - type: mrr_at_3
1668
+ value: 56.65599999999999
1669
+ - type: mrr_at_5
1670
+ value: 57.972
1671
+ - type: ndcg_at_1
1672
+ value: 48.452
1673
+ - type: ndcg_at_10
1674
+ value: 38.845
1675
+ - type: ndcg_at_100
1676
+ value: 36.597
1677
+ - type: ndcg_at_1000
1678
+ value: 45.472
1679
+ - type: ndcg_at_3
1680
+ value: 43.947
1681
+ - type: ndcg_at_5
1682
+ value: 42.097
1683
+ - type: precision_at_1
1684
+ value: 49.845
1685
+ - type: precision_at_10
1686
+ value: 28.638
1687
+ - type: precision_at_100
1688
+ value: 9.229
1689
+ - type: precision_at_1000
1690
+ value: 2.234
1691
+ - type: precision_at_3
1692
+ value: 40.867
1693
+ - type: precision_at_5
1694
+ value: 36.285000000000004
1695
+ - type: recall_at_1
1696
+ value: 7.225
1697
+ - type: recall_at_10
1698
+ value: 19.272
1699
+ - type: recall_at_100
1700
+ value: 37.299
1701
+ - type: recall_at_1000
1702
+ value: 68.757
1703
+ - type: recall_at_3
1704
+ value: 12.350999999999999
1705
+ - type: recall_at_5
1706
+ value: 15.369
1707
+ - task:
1708
+ type: Retrieval
1709
+ dataset:
1710
+ type: nq
1711
+ name: MTEB NQ
1712
+ config: default
1713
+ split: test
1714
+ revision: None
1715
+ metrics:
1716
+ - type: map_at_1
1717
+ value: 34.453
1718
+ - type: map_at_10
1719
+ value: 50.748000000000005
1720
+ - type: map_at_100
1721
+ value: 51.666000000000004
1722
+ - type: map_at_1000
1723
+ value: 51.687000000000005
1724
+ - type: map_at_3
1725
+ value: 46.300000000000004
1726
+ - type: map_at_5
1727
+ value: 49.032
1728
+ - type: mrr_at_1
1729
+ value: 38.673
1730
+ - type: mrr_at_10
1731
+ value: 53.11
1732
+ - type: mrr_at_100
1733
+ value: 53.772
1734
+ - type: mrr_at_1000
1735
+ value: 53.784
1736
+ - type: mrr_at_3
1737
+ value: 49.483
1738
+ - type: mrr_at_5
1739
+ value: 51.751999999999995
1740
+ - type: ndcg_at_1
1741
+ value: 38.673
1742
+ - type: ndcg_at_10
1743
+ value: 58.60300000000001
1744
+ - type: ndcg_at_100
1745
+ value: 62.302
1746
+ - type: ndcg_at_1000
1747
+ value: 62.763999999999996
1748
+ - type: ndcg_at_3
1749
+ value: 50.366
1750
+ - type: ndcg_at_5
1751
+ value: 54.888999999999996
1752
+ - type: precision_at_1
1753
+ value: 38.673
1754
+ - type: precision_at_10
1755
+ value: 9.522
1756
+ - type: precision_at_100
1757
+ value: 1.162
1758
+ - type: precision_at_1000
1759
+ value: 0.121
1760
+ - type: precision_at_3
1761
+ value: 22.779
1762
+ - type: precision_at_5
1763
+ value: 16.256999999999998
1764
+ - type: recall_at_1
1765
+ value: 34.453
1766
+ - type: recall_at_10
1767
+ value: 80.074
1768
+ - type: recall_at_100
1769
+ value: 95.749
1770
+ - type: recall_at_1000
1771
+ value: 99.165
1772
+ - type: recall_at_3
1773
+ value: 58.897999999999996
1774
+ - type: recall_at_5
1775
+ value: 69.349
1776
+ - task:
1777
+ type: Retrieval
1778
+ dataset:
1779
+ type: quora
1780
+ name: MTEB QuoraRetrieval
1781
+ config: default
1782
+ split: test
1783
+ revision: None
1784
+ metrics:
1785
+ - type: map_at_1
1786
+ value: 71.80499999999999
1787
+ - type: map_at_10
1788
+ value: 85.773
1789
+ - type: map_at_100
1790
+ value: 86.4
1791
+ - type: map_at_1000
1792
+ value: 86.414
1793
+ - type: map_at_3
1794
+ value: 82.919
1795
+ - type: map_at_5
1796
+ value: 84.70299999999999
1797
+ - type: mrr_at_1
1798
+ value: 82.69999999999999
1799
+ - type: mrr_at_10
1800
+ value: 88.592
1801
+ - type: mrr_at_100
1802
+ value: 88.682
1803
+ - type: mrr_at_1000
1804
+ value: 88.683
1805
+ - type: mrr_at_3
1806
+ value: 87.705
1807
+ - type: mrr_at_5
1808
+ value: 88.30799999999999
1809
+ - type: ndcg_at_1
1810
+ value: 82.69
1811
+ - type: ndcg_at_10
1812
+ value: 89.316
1813
+ - type: ndcg_at_100
1814
+ value: 90.45100000000001
1815
+ - type: ndcg_at_1000
1816
+ value: 90.525
1817
+ - type: ndcg_at_3
1818
+ value: 86.68
1819
+ - type: ndcg_at_5
1820
+ value: 88.113
1821
+ - type: precision_at_1
1822
+ value: 82.69
1823
+ - type: precision_at_10
1824
+ value: 13.507
1825
+ - type: precision_at_100
1826
+ value: 1.5350000000000001
1827
+ - type: precision_at_1000
1828
+ value: 0.157
1829
+ - type: precision_at_3
1830
+ value: 37.927
1831
+ - type: precision_at_5
1832
+ value: 24.823999999999998
1833
+ - type: recall_at_1
1834
+ value: 71.80499999999999
1835
+ - type: recall_at_10
1836
+ value: 95.965
1837
+ - type: recall_at_100
1838
+ value: 99.70400000000001
1839
+ - type: recall_at_1000
1840
+ value: 99.992
1841
+ - type: recall_at_3
1842
+ value: 88.268
1843
+ - type: recall_at_5
1844
+ value: 92.45
1845
+ - task:
1846
+ type: Clustering
1847
+ dataset:
1848
+ type: mteb/reddit-clustering
1849
+ name: MTEB RedditClustering
1850
+ config: default
1851
+ split: test
1852
+ revision: 24640382cdbf8abc73003fb0fa6d111a705499eb
1853
+ metrics:
1854
+ - type: v_measure
1855
+ value: 60.24178219867024
1856
+ - task:
1857
+ type: Clustering
1858
+ dataset:
1859
+ type: mteb/reddit-clustering-p2p
1860
+ name: MTEB RedditClusteringP2P
1861
+ config: default
1862
+ split: test
1863
+ revision: 282350215ef01743dc01b456c7f5241fa8937f16
1864
+ metrics:
1865
+ - type: v_measure
1866
+ value: 64.99552099515469
1867
+ - task:
1868
+ type: Retrieval
1869
+ dataset:
1870
+ type: scidocs
1871
+ name: MTEB SCIDOCS
1872
+ config: default
1873
+ split: test
1874
+ revision: None
1875
+ metrics:
1876
+ - type: map_at_1
1877
+ value: 5.4879999999999995
1878
+ - type: map_at_10
1879
+ value: 14.774999999999999
1880
+ - type: map_at_100
1881
+ value: 17.285
1882
+ - type: map_at_1000
1883
+ value: 17.648
1884
+ - type: map_at_3
1885
+ value: 10.4
1886
+ - type: map_at_5
1887
+ value: 12.552
1888
+ - type: mrr_at_1
1889
+ value: 27.1
1890
+ - type: mrr_at_10
1891
+ value: 39.251000000000005
1892
+ - type: mrr_at_100
1893
+ value: 40.335
1894
+ - type: mrr_at_1000
1895
+ value: 40.367
1896
+ - type: mrr_at_3
1897
+ value: 35.683
1898
+ - type: mrr_at_5
1899
+ value: 37.733
1900
+ - type: ndcg_at_1
1901
+ value: 27.1
1902
+ - type: ndcg_at_10
1903
+ value: 23.974
1904
+ - type: ndcg_at_100
1905
+ value: 33.161
1906
+ - type: ndcg_at_1000
1907
+ value: 38.853
1908
+ - type: ndcg_at_3
1909
+ value: 22.695999999999998
1910
+ - type: ndcg_at_5
1911
+ value: 19.881
1912
+ - type: precision_at_1
1913
+ value: 27.1
1914
+ - type: precision_at_10
1915
+ value: 12.479999999999999
1916
+ - type: precision_at_100
1917
+ value: 2.571
1918
+ - type: precision_at_1000
1919
+ value: 0.393
1920
+ - type: precision_at_3
1921
+ value: 21.367
1922
+ - type: precision_at_5
1923
+ value: 17.560000000000002
1924
+ - type: recall_at_1
1925
+ value: 5.4879999999999995
1926
+ - type: recall_at_10
1927
+ value: 25.290000000000003
1928
+ - type: recall_at_100
1929
+ value: 52.222
1930
+ - type: recall_at_1000
1931
+ value: 79.77300000000001
1932
+ - type: recall_at_3
1933
+ value: 13.001999999999999
1934
+ - type: recall_at_5
1935
+ value: 17.812
1936
+ - task:
1937
+ type: STS
1938
+ dataset:
1939
+ type: mteb/sickr-sts
1940
+ name: MTEB SICK-R
1941
+ config: default
1942
+ split: test
1943
+ revision: a6ea5a8cab320b040a23452cc28066d9beae2cee
1944
+ metrics:
1945
+ - type: cos_sim_pearson
1946
+ value: 85.3407705934785
1947
+ - type: cos_sim_spearman
1948
+ value: 81.28145766913589
1949
+ - type: euclidean_pearson
1950
+ value: 82.69277819943873
1951
+ - type: euclidean_spearman
1952
+ value: 81.26097565088551
1953
+ - type: manhattan_pearson
1954
+ value: 82.73440374725746
1955
+ - type: manhattan_spearman
1956
+ value: 81.25376873901254
1957
+ - task:
1958
+ type: STS
1959
+ dataset:
1960
+ type: mteb/sts12-sts
1961
+ name: MTEB STS12
1962
+ config: default
1963
+ split: test
1964
+ revision: a0d554a64d88156834ff5ae9920b964011b16384
1965
+ metrics:
1966
+ - type: cos_sim_pearson
1967
+ value: 87.23415639286914
1968
+ - type: cos_sim_spearman
1969
+ value: 79.80147936079915
1970
+ - type: euclidean_pearson
1971
+ value: 84.324220218071
1972
+ - type: euclidean_spearman
1973
+ value: 79.71794784987208
1974
+ - type: manhattan_pearson
1975
+ value: 84.27523842345964
1976
+ - type: manhattan_spearman
1977
+ value: 79.58070329781553
1978
+ - task:
1979
+ type: STS
1980
+ dataset:
1981
+ type: mteb/sts13-sts
1982
+ name: MTEB STS13
1983
+ config: default
1984
+ split: test
1985
+ revision: 7e90230a92c190f1bf69ae9002b8cea547a64cca
1986
+ metrics:
1987
+ - type: cos_sim_pearson
1988
+ value: 85.90966234413125
1989
+ - type: cos_sim_spearman
1990
+ value: 87.10742652814713
1991
+ - type: euclidean_pearson
1992
+ value: 86.28297063322286
1993
+ - type: euclidean_spearman
1994
+ value: 87.09425001932226
1995
+ - type: manhattan_pearson
1996
+ value: 86.19204338411774
1997
+ - type: manhattan_spearman
1998
+ value: 87.02046826723424
1999
+ - task:
2000
+ type: STS
2001
+ dataset:
2002
+ type: mteb/sts14-sts
2003
+ name: MTEB STS14
2004
+ config: default
2005
+ split: test
2006
+ revision: 6031580fec1f6af667f0bd2da0a551cf4f0b2375
2007
+ metrics:
2008
+ - type: cos_sim_pearson
2009
+ value: 84.12351399124411
2010
+ - type: cos_sim_spearman
2011
+ value: 83.32955357808568
2012
+ - type: euclidean_pearson
2013
+ value: 83.81222384305896
2014
+ - type: euclidean_spearman
2015
+ value: 83.1836394454507
2016
+ - type: manhattan_pearson
2017
+ value: 83.79162945392092
2018
+ - type: manhattan_spearman
2019
+ value: 83.14306058903364
2020
+ - task:
2021
+ type: STS
2022
+ dataset:
2023
+ type: mteb/sts15-sts
2024
+ name: MTEB STS15
2025
+ config: default
2026
+ split: test
2027
+ revision: ae752c7c21bf194d8b67fd573edf7ae58183cbe3
2028
+ metrics:
2029
+ - type: cos_sim_pearson
2030
+ value: 86.9345194840047
2031
+ - type: cos_sim_spearman
2032
+ value: 88.47286320653176
2033
+ - type: euclidean_pearson
2034
+ value: 87.72825182191445
2035
+ - type: euclidean_spearman
2036
+ value: 88.33484195475864
2037
+ - type: manhattan_pearson
2038
+ value: 87.75121043906692
2039
+ - type: manhattan_spearman
2040
+ value: 88.36695329548576
2041
+ - task:
2042
+ type: STS
2043
+ dataset:
2044
+ type: mteb/sts16-sts
2045
+ name: MTEB STS16
2046
+ config: default
2047
+ split: test
2048
+ revision: 4d8694f8f0e0100860b497b999b3dbed754a0513
2049
+ metrics:
2050
+ - type: cos_sim_pearson
2051
+ value: 84.80215370816441
2052
+ - type: cos_sim_spearman
2053
+ value: 86.44917331470305
2054
+ - type: euclidean_pearson
2055
+ value: 85.3458573021962
2056
+ - type: euclidean_spearman
2057
+ value: 86.24853627058414
2058
+ - type: manhattan_pearson
2059
+ value: 85.38477148579328
2060
+ - type: manhattan_spearman
2061
+ value: 86.28201585857053
2062
+ - task:
2063
+ type: STS
2064
+ dataset:
2065
+ type: mteb/sts17-crosslingual-sts
2066
+ name: MTEB STS17 (en-en)
2067
+ config: en-en
2068
+ split: test
2069
+ revision: af5e6fb845001ecf41f4c1e033ce921939a2a68d
2070
+ metrics:
2071
+ - type: cos_sim_pearson
2072
+ value: 87.20498617189688
2073
+ - type: cos_sim_spearman
2074
+ value: 87.61389142076317
2075
+ - type: euclidean_pearson
2076
+ value: 88.15430699740293
2077
+ - type: euclidean_spearman
2078
+ value: 87.35065666258774
2079
+ - type: manhattan_pearson
2080
+ value: 88.2994571119992
2081
+ - type: manhattan_spearman
2082
+ value: 87.60920178284005
2083
+ - task:
2084
+ type: STS
2085
+ dataset:
2086
+ type: mteb/sts22-crosslingual-sts
2087
+ name: MTEB STS22 (en)
2088
+ config: en
2089
+ split: test
2090
+ revision: 6d1ba47164174a496b7fa5d3569dae26a6813b80
2091
+ metrics:
2092
+ - type: cos_sim_pearson
2093
+ value: 68.27672577392406
2094
+ - type: cos_sim_spearman
2095
+ value: 68.31250175566586
2096
+ - type: euclidean_pearson
2097
+ value: 69.45016222616813
2098
+ - type: euclidean_spearman
2099
+ value: 67.93461301528046
2100
+ - type: manhattan_pearson
2101
+ value: 69.39774219739259
2102
+ - type: manhattan_spearman
2103
+ value: 67.78124856615536
2104
+ - task:
2105
+ type: STS
2106
+ dataset:
2107
+ type: mteb/stsbenchmark-sts
2108
+ name: MTEB STSBenchmark
2109
+ config: default
2110
+ split: test
2111
+ revision: b0fddb56ed78048fa8b90373c8a3cfc37b684831
2112
+ metrics:
2113
+ - type: cos_sim_pearson
2114
+ value: 85.31916148698113
2115
+ - type: cos_sim_spearman
2116
+ value: 87.45541524487057
2117
+ - type: euclidean_pearson
2118
+ value: 86.5845909408775
2119
+ - type: euclidean_spearman
2120
+ value: 87.2373331768082
2121
+ - type: manhattan_pearson
2122
+ value: 86.64467698948668
2123
+ - type: manhattan_spearman
2124
+ value: 87.26707857525533
2125
+ - task:
2126
+ type: Reranking
2127
+ dataset:
2128
+ type: mteb/scidocs-reranking
2129
+ name: MTEB SciDocsRR
2130
+ config: default
2131
+ split: test
2132
+ revision: d3c5e1fc0b855ab6097bf1cda04dd73947d7caab
2133
+ metrics:
2134
+ - type: map
2135
+ value: 88.0007930269447
2136
+ - type: mrr
2137
+ value: 96.52852594029063
2138
+ - task:
2139
+ type: Retrieval
2140
+ dataset:
2141
+ type: scifact
2142
+ name: MTEB SciFact
2143
+ config: default
2144
+ split: test
2145
+ revision: None
2146
+ metrics:
2147
+ - type: map_at_1
2148
+ value: 60.99400000000001
2149
+ - type: map_at_10
2150
+ value: 70.923
2151
+ - type: map_at_100
2152
+ value: 71.299
2153
+ - type: map_at_1000
2154
+ value: 71.318
2155
+ - type: map_at_3
2156
+ value: 67.991
2157
+ - type: map_at_5
2158
+ value: 69.292
2159
+ - type: mrr_at_1
2160
+ value: 64.333
2161
+ - type: mrr_at_10
2162
+ value: 71.98400000000001
2163
+ - type: mrr_at_100
2164
+ value: 72.306
2165
+ - type: mrr_at_1000
2166
+ value: 72.32499999999999
2167
+ - type: mrr_at_3
2168
+ value: 69.833
2169
+ - type: mrr_at_5
2170
+ value: 70.783
2171
+ - type: ndcg_at_1
2172
+ value: 64.333
2173
+ - type: ndcg_at_10
2174
+ value: 75.729
2175
+ - type: ndcg_at_100
2176
+ value: 77.38199999999999
2177
+ - type: ndcg_at_1000
2178
+ value: 77.788
2179
+ - type: ndcg_at_3
2180
+ value: 70.774
2181
+ - type: ndcg_at_5
2182
+ value: 72.478
2183
+ - type: precision_at_1
2184
+ value: 64.333
2185
+ - type: precision_at_10
2186
+ value: 10.167
2187
+ - type: precision_at_100
2188
+ value: 1.0999999999999999
2189
+ - type: precision_at_1000
2190
+ value: 0.11299999999999999
2191
+ - type: precision_at_3
2192
+ value: 27.778000000000002
2193
+ - type: precision_at_5
2194
+ value: 17.867
2195
+ - type: recall_at_1
2196
+ value: 60.99400000000001
2197
+ - type: recall_at_10
2198
+ value: 89.48899999999999
2199
+ - type: recall_at_100
2200
+ value: 97.0
2201
+ - type: recall_at_1000
2202
+ value: 100.0
2203
+ - type: recall_at_3
2204
+ value: 75.85
2205
+ - type: recall_at_5
2206
+ value: 80.328
2207
+ - task:
2208
+ type: PairClassification
2209
+ dataset:
2210
+ type: mteb/sprintduplicatequestions-pairclassification
2211
+ name: MTEB SprintDuplicateQuestions
2212
+ config: default
2213
+ split: test
2214
+ revision: d66bd1f72af766a5cc4b0ca5e00c162f89e8cc46
2215
+ metrics:
2216
+ - type: cos_sim_accuracy
2217
+ value: 99.86435643564356
2218
+ - type: cos_sim_ap
2219
+ value: 96.78001342960285
2220
+ - type: cos_sim_f1
2221
+ value: 93.07030854830552
2222
+ - type: cos_sim_precision
2223
+ value: 94.16581371545547
2224
+ - type: cos_sim_recall
2225
+ value: 92.0
2226
+ - type: dot_accuracy
2227
+ value: 99.74653465346535
2228
+ - type: dot_ap
2229
+ value: 92.80391251199522
2230
+ - type: dot_f1
2231
+ value: 87.36426456071075
2232
+ - type: dot_precision
2233
+ value: 86.25730994152046
2234
+ - type: dot_recall
2235
+ value: 88.5
2236
+ - type: euclidean_accuracy
2237
+ value: 99.86138613861387
2238
+ - type: euclidean_ap
2239
+ value: 96.77007810699926
2240
+ - type: euclidean_f1
2241
+ value: 92.95065458207452
2242
+ - type: euclidean_precision
2243
+ value: 93.6105476673428
2244
+ - type: euclidean_recall
2245
+ value: 92.30000000000001
2246
+ - type: manhattan_accuracy
2247
+ value: 99.86336633663366
2248
+ - type: manhattan_ap
2249
+ value: 96.78913160708261
2250
+ - type: manhattan_f1
2251
+ value: 93.03030303030305
2252
+ - type: manhattan_precision
2253
+ value: 93.9795918367347
2254
+ - type: manhattan_recall
2255
+ value: 92.10000000000001
2256
+ - type: max_accuracy
2257
+ value: 99.86435643564356
2258
+ - type: max_ap
2259
+ value: 96.78913160708261
2260
+ - type: max_f1
2261
+ value: 93.07030854830552
2262
+ - task:
2263
+ type: Clustering
2264
+ dataset:
2265
+ type: mteb/stackexchange-clustering
2266
+ name: MTEB StackExchangeClustering
2267
+ config: default
2268
+ split: test
2269
+ revision: 6cbc1f7b2bc0622f2e39d2c77fa502909748c259
2270
+ metrics:
2271
+ - type: v_measure
2272
+ value: 67.80798406371026
2273
+ - task:
2274
+ type: Clustering
2275
+ dataset:
2276
+ type: mteb/stackexchange-clustering-p2p
2277
+ name: MTEB StackExchangeClusteringP2P
2278
+ config: default
2279
+ split: test
2280
+ revision: 815ca46b2622cec33ccafc3735d572c266efdb44
2281
+ metrics:
2282
+ - type: v_measure
2283
+ value: 35.69251193913337
2284
+ - task:
2285
+ type: Reranking
2286
+ dataset:
2287
+ type: mteb/stackoverflowdupquestions-reranking
2288
+ name: MTEB StackOverflowDupQuestions
2289
+ config: default
2290
+ split: test
2291
+ revision: e185fbe320c72810689fc5848eb6114e1ef5ec69
2292
+ metrics:
2293
+ - type: map
2294
+ value: 55.04250964616215
2295
+ - type: mrr
2296
+ value: 55.92283125371361
2297
+ - task:
2298
+ type: Summarization
2299
+ dataset:
2300
+ type: mteb/summeval
2301
+ name: MTEB SummEval
2302
+ config: default
2303
+ split: test
2304
+ revision: cda12ad7615edc362dbf25a00fdd61d3b1eaf93c
2305
+ metrics:
2306
+ - type: cos_sim_pearson
2307
+ value: 31.05492162235311
2308
+ - type: cos_sim_spearman
2309
+ value: 30.90473006515039
2310
+ - type: dot_pearson
2311
+ value: 26.85480454105073
2312
+ - type: dot_spearman
2313
+ value: 27.02880537417923
2314
+ - task:
2315
+ type: Retrieval
2316
+ dataset:
2317
+ type: trec-covid
2318
+ name: MTEB TRECCOVID
2319
+ config: default
2320
+ split: test
2321
+ revision: None
2322
+ metrics:
2323
+ - type: map_at_1
2324
+ value: 0.246
2325
+ - type: map_at_10
2326
+ value: 2.125
2327
+ - type: map_at_100
2328
+ value: 12.892999999999999
2329
+ - type: map_at_1000
2330
+ value: 31.513999999999996
2331
+ - type: map_at_3
2332
+ value: 0.695
2333
+ - type: map_at_5
2334
+ value: 1.133
2335
+ - type: mrr_at_1
2336
+ value: 92.0
2337
+ - type: mrr_at_10
2338
+ value: 95.667
2339
+ - type: mrr_at_100
2340
+ value: 95.667
2341
+ - type: mrr_at_1000
2342
+ value: 95.667
2343
+ - type: mrr_at_3
2344
+ value: 95.667
2345
+ - type: mrr_at_5
2346
+ value: 95.667
2347
+ - type: ndcg_at_1
2348
+ value: 88.0
2349
+ - type: ndcg_at_10
2350
+ value: 82.464
2351
+ - type: ndcg_at_100
2352
+ value: 63.351
2353
+ - type: ndcg_at_1000
2354
+ value: 57.129
2355
+ - type: ndcg_at_3
2356
+ value: 85.87700000000001
2357
+ - type: ndcg_at_5
2358
+ value: 86.042
2359
+ - type: precision_at_1
2360
+ value: 92.0
2361
+ - type: precision_at_10
2362
+ value: 86.2
2363
+ - type: precision_at_100
2364
+ value: 65.10000000000001
2365
+ - type: precision_at_1000
2366
+ value: 25.044
2367
+ - type: precision_at_3
2368
+ value: 89.333
2369
+ - type: precision_at_5
2370
+ value: 89.60000000000001
2371
+ - type: recall_at_1
2372
+ value: 0.246
2373
+ - type: recall_at_10
2374
+ value: 2.2880000000000003
2375
+ - type: recall_at_100
2376
+ value: 15.853
2377
+ - type: recall_at_1000
2378
+ value: 54.05
2379
+ - type: recall_at_3
2380
+ value: 0.72
2381
+ - type: recall_at_5
2382
+ value: 1.196
2383
+ - task:
2384
+ type: Retrieval
2385
+ dataset:
2386
+ type: webis-touche2020
2387
+ name: MTEB Touche2020
2388
+ config: default
2389
+ split: test
2390
+ revision: None
2391
+ metrics:
2392
+ - type: map_at_1
2393
+ value: 3.322
2394
+ - type: map_at_10
2395
+ value: 11.673
2396
+ - type: map_at_100
2397
+ value: 18.655
2398
+ - type: map_at_1000
2399
+ value: 20.058999999999997
2400
+ - type: map_at_3
2401
+ value: 6.265
2402
+ - type: map_at_5
2403
+ value: 8.549
2404
+ - type: mrr_at_1
2405
+ value: 42.857
2406
+ - type: mrr_at_10
2407
+ value: 55.352999999999994
2408
+ - type: mrr_at_100
2409
+ value: 55.928999999999995
2410
+ - type: mrr_at_1000
2411
+ value: 55.928999999999995
2412
+ - type: mrr_at_3
2413
+ value: 50.0
2414
+ - type: mrr_at_5
2415
+ value: 53.571000000000005
2416
+ - type: ndcg_at_1
2417
+ value: 39.796
2418
+ - type: ndcg_at_10
2419
+ value: 28.225
2420
+ - type: ndcg_at_100
2421
+ value: 40.452
2422
+ - type: ndcg_at_1000
2423
+ value: 51.332
2424
+ - type: ndcg_at_3
2425
+ value: 32.308
2426
+ - type: ndcg_at_5
2427
+ value: 30.942999999999998
2428
+ - type: precision_at_1
2429
+ value: 42.857
2430
+ - type: precision_at_10
2431
+ value: 24.490000000000002
2432
+ - type: precision_at_100
2433
+ value: 8.366999999999999
2434
+ - type: precision_at_1000
2435
+ value: 1.5709999999999997
2436
+ - type: precision_at_3
2437
+ value: 32.653
2438
+ - type: precision_at_5
2439
+ value: 30.203999999999997
2440
+ - type: recall_at_1
2441
+ value: 3.322
2442
+ - type: recall_at_10
2443
+ value: 17.857
2444
+ - type: recall_at_100
2445
+ value: 51.169
2446
+ - type: recall_at_1000
2447
+ value: 85.382
2448
+ - type: recall_at_3
2449
+ value: 7.126
2450
+ - type: recall_at_5
2451
+ value: 11.186
2452
+ - task:
2453
+ type: Classification
2454
+ dataset:
2455
+ type: mteb/toxic_conversations_50k
2456
+ name: MTEB ToxicConversationsClassification
2457
+ config: default
2458
+ split: test
2459
+ revision: d7c0de2777da35d6aae2200a62c6e0e5af397c4c
2460
+ metrics:
2461
+ - type: accuracy
2462
+ value: 72.1046
2463
+ - type: ap
2464
+ value: 14.84774372187047
2465
+ - type: f1
2466
+ value: 55.52709376912111
2467
+ - task:
2468
+ type: Classification
2469
+ dataset:
2470
+ type: mteb/tweet_sentiment_extraction
2471
+ name: MTEB TweetSentimentExtractionClassification
2472
+ config: default
2473
+ split: test
2474
+ revision: d604517c81ca91fe16a244d1248fc021f9ecee7a
2475
+ metrics:
2476
+ - type: accuracy
2477
+ value: 60.18958687040181
2478
+ - type: f1
2479
+ value: 60.53154943862625
2480
+ - task:
2481
+ type: Clustering
2482
+ dataset:
2483
+ type: mteb/twentynewsgroups-clustering
2484
+ name: MTEB TwentyNewsgroupsClustering
2485
+ config: default
2486
+ split: test
2487
+ revision: 6125ec4e24fa026cec8a478383ee943acfbd5449
2488
+ metrics:
2489
+ - type: v_measure
2490
+ value: 54.61440440799667
2491
+ - task:
2492
+ type: PairClassification
2493
+ dataset:
2494
+ type: mteb/twittersemeval2015-pairclassification
2495
+ name: MTEB TwitterSemEval2015
2496
+ config: default
2497
+ split: test
2498
+ revision: 70970daeab8776df92f5ea462b6173c0b46fd2d1
2499
+ metrics:
2500
+ - type: cos_sim_accuracy
2501
+ value: 87.34577099600644
2502
+ - type: cos_sim_ap
2503
+ value: 78.19613471607386
2504
+ - type: cos_sim_f1
2505
+ value: 71.30501144746884
2506
+ - type: cos_sim_precision
2507
+ value: 68.83595284872298
2508
+ - type: cos_sim_recall
2509
+ value: 73.95778364116094
2510
+ - type: dot_accuracy
2511
+ value: 82.89324670680098
2512
+ - type: dot_ap
2513
+ value: 63.02362697550343
2514
+ - type: dot_f1
2515
+ value: 59.69837587006961
2516
+ - type: dot_precision
2517
+ value: 53.2712215320911
2518
+ - type: dot_recall
2519
+ value: 67.8891820580475
2520
+ - type: euclidean_accuracy
2521
+ value: 87.24444179531503
2522
+ - type: euclidean_ap
2523
+ value: 78.38356749852895
2524
+ - type: euclidean_f1
2525
+ value: 71.42133265771471
2526
+ - type: euclidean_precision
2527
+ value: 68.68908382066277
2528
+ - type: euclidean_recall
2529
+ value: 74.37994722955145
2530
+ - type: manhattan_accuracy
2531
+ value: 87.24444179531503
2532
+ - type: manhattan_ap
2533
+ value: 78.27660966609476
2534
+ - type: manhattan_f1
2535
+ value: 71.42165173165415
2536
+ - type: manhattan_precision
2537
+ value: 66.00268576544315
2538
+ - type: manhattan_recall
2539
+ value: 77.81002638522428
2540
+ - type: max_accuracy
2541
+ value: 87.34577099600644
2542
+ - type: max_ap
2543
+ value: 78.38356749852895
2544
+ - type: max_f1
2545
+ value: 71.42165173165415
2546
+ - task:
2547
+ type: PairClassification
2548
+ dataset:
2549
+ type: mteb/twitterurlcorpus-pairclassification
2550
+ name: MTEB TwitterURLCorpus
2551
+ config: default
2552
+ split: test
2553
+ revision: 8b6510b0b1fa4e4c4f879467980e9be563ec1cdf
2554
+ metrics:
2555
+ - type: cos_sim_accuracy
2556
+ value: 88.90829355377032
2557
+ - type: cos_sim_ap
2558
+ value: 85.79696678631824
2559
+ - type: cos_sim_f1
2560
+ value: 77.8494623655914
2561
+ - type: cos_sim_precision
2562
+ value: 76.32610786417105
2563
+ - type: cos_sim_recall
2564
+ value: 79.43486295041576
2565
+ - type: dot_accuracy
2566
+ value: 86.17223580548765
2567
+ - type: dot_ap
2568
+ value: 79.05804163697516
2569
+ - type: dot_f1
2570
+ value: 72.38855622089154
2571
+ - type: dot_precision
2572
+ value: 69.61467368121713
2573
+ - type: dot_recall
2574
+ value: 75.39267015706807
2575
+ - type: euclidean_accuracy
2576
+ value: 88.94128148406877
2577
+ - type: euclidean_ap
2578
+ value: 85.86615739743813
2579
+ - type: euclidean_f1
2580
+ value: 77.97001153402537
2581
+ - type: euclidean_precision
2582
+ value: 75.44099647202822
2583
+ - type: euclidean_recall
2584
+ value: 80.67446874037573
2585
+ - type: manhattan_accuracy
2586
+ value: 88.9781503473435
2587
+ - type: manhattan_ap
2588
+ value: 85.91093266751166
2589
+ - type: manhattan_f1
2590
+ value: 77.96835723791216
2591
+ - type: manhattan_precision
2592
+ value: 74.98577929465301
2593
+ - type: manhattan_recall
2594
+ value: 81.19802894979982
2595
+ - type: max_accuracy
2596
+ value: 88.9781503473435
2597
+ - type: max_ap
2598
+ value: 85.91093266751166
2599
+ - type: max_f1
2600
+ value: 77.97001153402537
2601
+ ---