intfloat commited on
Commit
e272f30
1 Parent(s): bc453e7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -2699,6 +2699,14 @@ Here are some rules of thumb:
2699
 
2700
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
2701
 
 
 
 
 
 
 
 
 
2702
  ## Citation
2703
 
2704
  If you find our paper or models helpful, please consider cite as follows:
 
2699
 
2700
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
2701
 
2702
+ **3. Why does the cosine similarity scores distribute around 0.7 to 1.0?**
2703
+
2704
+ This is a known and expected behavior as we use a low temperature 0.01 for InfoNCE contrastive loss.
2705
+
2706
+ For text embedding tasks like text retrieval or semantic similarity,
2707
+ what matters is the relative order of the scores instead of the absolute values,
2708
+ so this should not be an issue.
2709
+
2710
  ## Citation
2711
 
2712
  If you find our paper or models helpful, please consider cite as follows: