Sentence Similarity
sentence-transformers
PyTorch
Safetensors
xmod
passage-retrieval

Token limit and fixed prefixes ?

#2
by rjalexa - opened

Is there a token limit (context window) for the input text? Would be nice to know if I need to partition the corpus.
Also not entirely sure if the passages and the queries need a prefix pattern.
Merci beacoup !!! :)

Hey, the model's max input length is 512 tokens. No prefix required!

Thank you very much.

rjalexa changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment