what about an quantized version so we can load in Exlama with large context size?

by DQ83 - opened Aug 15, 2023

DQ83

Aug 15, 2023

i think coding models should all have large context sizes. A lot of models like losslessmega encoder , CodeUp, StableCode....dont work with Exlama tho :(
any hope for this one?
@TheBloke

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment