GGUFs available?

#1
by sdstealth - opened

Are there any GGUF files available for this model yet? Trying to add in LM studio and it's not finding anything. The 1.2 is good but can't wait to try this one.

Oh didn't realized it failed to upload.

Oh didn't realized it failed to upload.

Oh nice okay-- do you mind uploading again? Super eager to try this!

I've managed to upload Q4 and Q5 quants for now. But Bartowski is working on his quants for this model.

Sign up or log in to comment