wuriaee-12B-schizostock-GGUF imatrix quant

#644
by korus69 - opened

https://huggingface.co/mradermacher/wuriaee-12B-schizostock-GGUF

can you make an imatrix quant version? thanks

It's queued! :)

You can check for progress at http://hf.tst.eu/status.html
or regularly check the model summary page at https://hf.tst.eu/model#wuriaee-12B-schizostock-i1-GGUF for quants to appear.

@mradermacher I assume that queueing it like this was the right approach as there was no way for me to do imatrix quants of an existing model without force adding it.

nico1 ~# llmc add force -2000 i https://huggingface.co/redrix/wuriaee-12B-schizostock
submit tokens: ["force","-2000","imatrix","https://huggingface.co/redrix/wuriaee-12B-schizostock"]
https://huggingface.co/redrix/wuriaee-12B-schizostock
["https://huggingface.co/redrix/wuriaee-12B-schizostock",["s","0"],1737547506],
https://huggingface.co/redrix/wuriaee-12B-schizostock already in llmjob.submit.txt
forcing.

Yes, you have to force-add it. The "already in" mechanism is mainly a safety net to avoid big mistakes, double submissions, or collisions in model names (it greps for the model name, not the url). I generally always add the static job too in such cases - it might add missing quants, and if there aren't none, it'll just skip everything. The idea is that we are already going to the effort of downloading and converting it.

mradermacher changed discussion status to closed

Sign up or log in to comment