NeverSleep

/

MiquMaid-v3-70B-GGUF

like 3

Hello, can you please upload imatrix data for this model, so it can be at least manually quantized for IQ2_XS or similar quants?

Hi! I don't have them, since it's the step that take the longest time, I would have uploaded the iMatrix quant directly and not the static one if I had it haha, I'm sorry
But I will maybe make it myself if nobody does it

https://huggingface.co/mradermacher/MiquMaid-v3-70B-i1-GGUF has an imatrix.dat and is full of quants. Not the imatrix unid95 would have done, but it's an imatrix :)

Oh, thank you very much! It seems I didn't search properly.