Replying for user and 'assistant' on the end of messages
#2
by
rdtfddgrffdgfdghfghdfujgdhgsf
- opened
Trying with Faraday and using the llama3 setting, it's putting "assistant" on the end of every message, and ignoring the instruction to only write for itself and is instead writing for my character too.
Just giving feedback, as I'm not at all techy :)
Had the same problem, fixed this by following this guide:
https://www.reddit.com/r/LocalLLaMA/comments/1c7dkxh/tutorial_how_to_make_llama3instruct_ggufs_less/
Like I said, I'm not at all techy :)
"you must have llama.cpp setup correctly with python" *nervous giggles
Give KoboldCpp a try it allows you more tools to filter that kind of stuff out.