prithivida
commited on
Commit
•
a32a5c1
1
Parent(s):
4f54ad2
changed image width
Browse files
README.md
CHANGED
@@ -31,10 +31,10 @@ SPLADE models are a fine balance between retrieval effectiveness (quality) and r
|
|
31 |
**TL;DR of Our attempt & results**
|
32 |
1. FLOPS tuning: Seperate **Seq lens and Severely restrictive token budget** doc(128) & query(24) NOT 256 unlike Official SPLADE++. Inspired from **SparseEmbed** (instead of 2 models for query & doc).
|
33 |
3. Init Weights: **MLM adapted on MS MARCO corpus**.
|
34 |
-
4. Achieves a modest yet competitive effectiveness **MRR@10 37.22** in ID data (& OOD) and a retrieval latency of - **47.27ms**. (multi-threaded) all On **
|
35 |
4. For Industry setting: Effectiveness on custom domains needs more than just **Trading FLOPS for tiny gains** and The Premise "SPLADE++ are not well suited to mono-cpu retrieval" does not hold.
|
36 |
|
37 |
-
<img src="./ID.png" width=
|
38 |
|
39 |
*Note: The paper refers to the best performing models as SPLADE++, hence for consistency we are reusing the same.*
|
40 |
|
|
|
31 |
**TL;DR of Our attempt & results**
|
32 |
1. FLOPS tuning: Seperate **Seq lens and Severely restrictive token budget** doc(128) & query(24) NOT 256 unlike Official SPLADE++. Inspired from **SparseEmbed** (instead of 2 models for query & doc).
|
33 |
3. Init Weights: **MLM adapted on MS MARCO corpus**.
|
34 |
+
4. Achieves a modest yet competitive effectiveness **MRR@10 37.22** in ID data (& OOD) and a retrieval latency of - **47.27ms**. (multi-threaded) all On **Consumer grade-GPUs** with **only 5 negatives per query**.
|
35 |
4. For Industry setting: Effectiveness on custom domains needs more than just **Trading FLOPS for tiny gains** and The Premise "SPLADE++ are not well suited to mono-cpu retrieval" does not hold.
|
36 |
|
37 |
+
<img src="./ID.png" width=650 height=500/>
|
38 |
|
39 |
*Note: The paper refers to the best performing models as SPLADE++, hence for consistency we are reusing the same.*
|
40 |
|