script to ggml quantize this model?
#6
by
MichelNivard
- opened
Anyone have a script for quantizing this model for use with llama.cpp (so GGML format)?
I came here today (Christmas Day) looking for the same thing. The current llama.cpp convert scripts do not work.
Since you posted this in July and no one else has replied, I'm guessing it won't or can't be converted.