wuriaee-12B-schizostock-GGUF imatrix quant
https://huggingface.co/mradermacher/wuriaee-12B-schizostock-GGUF
can you make an imatrix quant version? thanks
It's queued! :)
You can check for progress at http://hf.tst.eu/status.html
or regularly check the model summary page at https://hf.tst.eu/model#wuriaee-12B-schizostock-i1-GGUF for quants to appear.
@mradermacher I assume that queueing it like this was the right approach as there was no way for me to do imatrix quants of an existing model without force adding it.
nico1 ~# llmc add force -2000 i https://huggingface.co/redrix/wuriaee-12B-schizostock
submit tokens: ["force","-2000","imatrix","https://huggingface.co/redrix/wuriaee-12B-schizostock"]
https://huggingface.co/redrix/wuriaee-12B-schizostock
["https://huggingface.co/redrix/wuriaee-12B-schizostock",["s","0"],1737547506],
https://huggingface.co/redrix/wuriaee-12B-schizostock already in llmjob.submit.txt
forcing.
Yes, you have to force-add it. The "already in" mechanism is mainly a safety net to avoid big mistakes, double submissions, or collisions in model names (it greps for the model name, not the url). I generally always add the static job too in such cases - it might add missing quants, and if there aren't none, it'll just skip everything. The idea is that we are already going to the effort of downloading and converting it.