exllama version?

#1
by Nexesenex - opened

Hey!
Which version of exllama do you use to quantize? Since 0.0.11, quants have been improved.

I get the latest version of the repo at the time i quant a new model, so the FlatOrcamaid quants are made with 0.0.11 plus whatever other changes had been made at that time.
Note that this specific model is an MLX, not a exllama

Oh, my bad, I'm used to check your exl2 quants and didn't pay attention!
Nevertheless, thank you for the information!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment