Config.json missing model_max_length

by MarsupialAI - opened Apr 4

Apr 4

Ran into an error trying to quantize this with LCPP. Adding

"model_max_length": 131072

resolved that error. There are other errors which are likely on the LCPP side of things, but you probably want to fix your config.

I'm assuming the max length I entered is correct?

ahmetustun changed discussion status to closed Apr 4

ahmetustun changed discussion status to open Apr 4

Cohere For AI org Apr 4

Thanks for noticing, I have updated the config.

ahmetustun changed discussion status to closed Apr 4

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment