Context Length

#6
by Darkknight535 - opened

Eh how to use context Length more than 8k, rope scaling?? I'm using llamacpp as backend it shows 8k ctx length.

Do I need to change it in config of max_position_embeddings?

Sign up or log in to comment