numb3r3
commited on
Commit
•
c28b4db
1
Parent(s):
907c4fb
chore: init readme
Browse files
README.md
CHANGED
|
@@ -98,16 +98,16 @@ scores = model.compute_score(sentence_pairs)
|
|
| 98 |
|
| 99 |
We evaluated Jina Reranker on 3 key benchmarks to ensure top-tier performance and search relevance.
|
| 100 |
|
| 101 |
-
| Model Name
|
| 102 |
-
|
|
| 103 |
-
| `jina-rereanker-v1-base-en`
|
| 104 |
-
| `jina-rereanker-v1-turbo-en` | **49.60** | **69.21** | **85.13** |
|
| 105 |
-
| `jina-rereanker-v1-tiny-en`
|
| 106 |
-
| `mxbai-rerank-base-v1`
|
| 107 |
-
| `mxbai-rerank-xsmall-v1`
|
| 108 |
-
| `ms-marco-MiniLM-L-6-v2`
|
| 109 |
-
| `ms-marco-MiniLM-L-4-v2`
|
| 110 |
-
| `bge-reranker-base`
|
| 111 |
|
| 112 |
**Note:**
|
| 113 |
|
|
|
|
| 98 |
|
| 99 |
We evaluated Jina Reranker on 3 key benchmarks to ensure top-tier performance and search relevance.
|
| 100 |
|
| 101 |
+
| Model Name | NDCG@10 (17 BEIR datasets) | NDCG@10 (5 LoCo datasets) | Hit Rate (LlamaIndex RAG) |
|
| 102 |
+
| ------------------------------------------- | -------------------------- | ------------------------- | ------------------------- |
|
| 103 |
+
| `jina-rereanker-v1-base-en` | **52.45** | **87.31** | **85.53** |
|
| 104 |
+
| `jina-rereanker-v1-turbo-en` (you are here) | **49.60** | **69.21** | **85.13** |
|
| 105 |
+
| `jina-rereanker-v1-tiny-en` | **48.54** | **70.29** | **85.00** |
|
| 106 |
+
| `mxbai-rerank-base-v1` | 49.19 | - | 82.50 |
|
| 107 |
+
| `mxbai-rerank-xsmall-v1` | 48.80 | - | 83.69 |
|
| 108 |
+
| `ms-marco-MiniLM-L-6-v2` | 48.64 | - | 82.63 |
|
| 109 |
+
| `ms-marco-MiniLM-L-4-v2` | 47.81 | - | 83.82 |
|
| 110 |
+
| `bge-reranker-base` | 47.89 | - | 83.03 |
|
| 111 |
|
| 112 |
**Note:**
|
| 113 |
|