Context length

by mrfakename - opened Nov 1, 2024

Nov 1, 2024

Hi,
Thanks for releasing this model! What is the context length?
Thanks!

Xenova

Hugging Face Smol Models Research org Nov 1, 2024

Hi! As stated in the config.json, the model has a context length of 8192 tokens.

Nov 2, 2024

Thanks!
Are there any plans to release a long-context version of the model?

mrfakename changed discussion status to closed Nov 2, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment