intfloat commited on
Commit
b1a0e29
1 Parent(s): 061a1bb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md CHANGED
@@ -6923,6 +6923,14 @@ Here are some rules of thumb:
6923
 
6924
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
6925
 
 
 
 
 
 
 
 
 
6926
  ## Citation
6927
 
6928
  If you find our paper or models helpful, please consider cite as follows:
 
6923
 
6924
  Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
6925
 
6926
+ **3. Why does the cosine similarity scores distribute around 0.7 to 1.0?**
6927
+
6928
+ This is a known and expected behavior as we use a low temperature 0.01 for InfoNCE contrastive loss.
6929
+
6930
+ For text embedding tasks like text retrieval or semantic similarity,
6931
+ what matters is the relative order of the scores instead of the absolute values,
6932
+ so this should not be an issue.
6933
+
6934
  ## Citation
6935
 
6936
  If you find our paper or models helpful, please consider cite as follows: