Amazing, but one issue
#4
by
WOOSAH
- opened
This LLM is absolutely fantastic. I've tried so many roleplay models and this is THE ONE. However, there is a major issue plaguing this model. Maybe it's because I use Ollama or maybe I have something setup wrong, but; when the chat conversation gets pretty long (About 9500 tickets long) It just stops responding. I can't get another message out of it..
i'm using it with 16k context length with no problems, must be issue with your frontend program, use sillytavern and the presets the model provides, and use aphrodite Engine for better handling it supports almost all quants and is fast.