What is the context size of this model?

#2
by TerraNull - opened

这个模型中文会出现乱码

SambaNova Systems org

Hi TerraNull! the context size is 2048, but given the alibi position embedding theoretically you can do more during inference :)

Hey zhouyiqq! thanks for the feedback, we will append this comment to our TODO list, thanks!

ChangranHuuu changed discussion status to closed

Sign up or log in to comment