What is the context size of this model?

#15
by saikatkumardey - opened

Is it 4k or 8k?

It’s 8k context

is the inference context length also 8K or can it go higher?

With sliding window I think it can reach 32k as it says but normally it’s around 7 to 8k

With sliding window I think it can reach 32k as it says but normally it’s around 7 to 8k

Please cite a source :)

With sliding window I think it can reach 32k as it says but normally it’s around 7 to 8k

Please cite a source :)

Here, official site, it states 8K for the base model. I am not sure if that could have been changed for the Instruct version.
https://mistral.ai/product/

Thanks :)

Sign up or log in to comment