not sure if this can be quantized. it's peculiar

#536
by mangojesus - opened

https://huggingface.co/Canstralian/RabbitRedux/tree/main

i had a hard time navigating this, but it looks like it has everything to be quantized? (question mark)

It can unfortunately not be quantized as there is no model. What you probably believed to be a model is in reality a python script as you can see under: https://huggingface.co/Canstralian/RabbitRedux/blob/main/model/pytorch_model.bin

Oh my, there goes the statistics for 2025 :)

mradermacher changed discussion status to closed

Sign up or log in to comment