TheBloke

/

Yarn-Llama-2-7B-128K-AWQ

like 0

Hi,
Thank you for sharing the model. In the model card, sequence length is listed as 4096. Can I use the quantized model with 128K context?