Sentence Similarity
sentence-transformers
PyTorch
Safetensors
xmod
passage-retrieval

Token limit and fixed prefixes ?

#2
by rjalexa - opened

Is there a token limit (context window) for the input text? Would be nice to know if I need to partition the corpus.
Also not entirely sure if the passages and the queries need a prefix pattern.
Merci beacoup !!! :)

Hey, the model's max input length is 512 tokens. No prefix required!

Thank you very much.

rjalexa changed discussion status to closed

Sign up or log in to comment