GGUF Quants?

#1
by CyberTimon - opened

Hello

Thanks very much for this work!
Is it possible to get the GGUF quants for this model, to use it later in llama.cpp or lm studio?

Thank you very much!

TIGER-Lab org

Thanks for the suggestions! I will try check whether it's possibly later today or tomorrow. Will upload one if it works and notice you here!

Thank you very much. Would be so cool if it works :)

I'm looking forward to it too

Sign up or log in to comment