Any chance of a GPTQ version for use with ExLLama

by anujn - opened Aug 18, 2023

anujn

Aug 18, 2023

Hey emozilla!
Thanks for all your context length work, mind bedignly amazing.

Just wondering if theres any chance of you making a GPTQ quantised version of this, mainly for use with Exllama.

All the best!

anujn

Aug 23, 2023

@TheBloke Not sure if you have time, but a GPTQ version of this would be amazing!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment