IQ4_XS-iMat-EN equals to IQ4_XS. Or not?
#1
by
JeroenAdam
- opened
As title states.
IQ4_XS-iMat-EN (Qwen 2.5 NON-coder) are available and tests have shown that it comes close to Q5_K_S in terms of performance.
So I was wondering if the IQ4_XS in this repo (Qwen 2.5 coder) is also such an iMat-EN quantization.
yes it's an imatrix, and the dataset is mostly english with a few others sprinkled in
notably this doesn't tend to degrade non-english performance for what it's worth