Broken quants
#1
by
snoopynoob
- opened
Seems like quants have a problem, I cant get it to work, all what I have is error in koboldccp (v1.66).
I tested it with q8 and q6 all the same
Here is a link to koboldccp crash - https://pastebin.com/XezyV9Ms
Your koboldcpp is outdated, you need a newer version.
mradermacher
changed discussion status to
closed