Gibberish after ~2k ctx
#3
by
urtuuuu
- opened
All phi-3-mini-4k gguf's that i tried always work up to ~2k ctx lengths, then they start to generate nonsense, random words. What am i doing wrong? I'm using LM studio. But i think its same in oobabooga.
urtuuuu
changed discussion status to
closed