Gibberish Output in Ooba
#1
by
afoland
- opened
I get gibberish output when running this in ooba.
I've successfully run the 3-bit GGUF version from TheBloke. Running on dual-3090, VRAM use at 21 and 19.
I used vicuna, and tried chat, chat-instruct, and instruct. I tried multiple different presets but they all give the same results.
No matter what I ask or how I set things, I get close variants of this as response:
zor Domain Cord StringBuilder Cord Cord Cord Corduo cordzorDomain Cordumar Domain Cordzor Domainzorzor Domainzorzor domains Cordzor Domain Domain Cordzorzorzor Domain Cord Domain Cord Cordzor Cord Domain Cord Cord Cord Cord Cord Cord Cordzor Cordzorzor Domainzor Cord Cord Domain Cord Cord
Unset this option in ooba:
Thanks, this worked!