I'm getting absolute gibberish with this model, don't know what i'm doing wrong.
I don't even know where it pulled this Alice from.
Attempt 2
it's actually broken.
whoops, posted under wrong model. this is with DavidAU/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-GGUF
Hmm ; looks like the model does not have enough context to process the character card and "yes/no" .
Also may be an issue of parameters :
Specifically REP PEN and TEMP.
It looks like the temp is too low and/or rep pen too low.
Looks like "love_letters.py" is running Llamacpp? Other?
It also could be something simple like wrong template (model requires Llama3) ?
The character card is 1.7k tokens, and this is after my reply to the first message. Temp was at 1.2, rep pen was at 1.05. i used the standard llama3 preset. i don't even know what love_letters.py is.
@BigBeavis
Suggest you try the model with lmstudio, backyard, webui, ollama ... no telling what love_letter(s).py is doing to the input / model etc.