REQUEST: Quant 8 request
#1
by
fathyshalaby
- opened
I would like to request a quant 8 version of this model if possible, thanks in advance.
Hi @fathyshalaby , I plan to release a better llama2-based German model in the coming days and will release this with more quantized versions. As of know I only run finetunes peridodically and need access to a beefy instance for quantization, so I will try to provide q-8 for this but could take a few days...
In the meantime I would be interested in feedback or usecases for the model!