additional non k-quants req
#7
by
ct-2
- opened
hi, I was wondering if you could kindly upload a few more, (q4_1) if you still have the HF files.
I found this q4_k_m (possibly more) model not working on certain platforms. (android) However, q4_0 is working.
Quite strange, as other kquant falcon models tested on arm work.