Broken model!

#1
by wolfram - opened

airoboros-l2-70b-3.1.2.Q4_0.gguf is outputting nonsense:

brie◄ cabigliateckgenommenÝbriebriebriebriebriebriebriebriebriebriebriebriebr...

Looks like that old problem I reported a while ago: TheBloke/Spicyboros-70B-2.2-GGUF # 1 spicyboros-70b-2.2.Q4_0.gguf broken as well?

Cant make model work, only gibberish in the output

"brieiomgreswehrrobloyeehung Feder prolong"

Using llama.cpp cpu only

Sign up or log in to comment