bartowski

/

Mistral-Small-Instruct-2409-GGUF

like 44

Thank you for the wonderful work you do.
I wasn't sure if the error I'm seeing is related to the other prompt post so I've created a separate post (this one).

You asked for feedback on the QX_K_X models. Here's my input. I downloaded from HF today and I get a "failed to send prompt" error (paraphrasing) when attempting to use this in LMStudio 0.3.2 in Linux. It complains of a missing "else" of some sort.

I tried both Q4_K_M and Q4_0_4_4. Both abended.