What's the correct chat template?
#3
by
FrenzyBiscuit
- opened
Running into issues with chat completion because the template is wrong.
Can you post the correct/fixed version for it?
Thanks!
Skyfall uses Metharme (Pygmalion in SillyTavern)
<system>sys msg<user>usr msg<assistant>ass msg
I've never messed with the tokenizer_config.json before, what would I need to replace in there for chat completion to work correctly?
I've tried to use a few of your other working models, such as cydonia v1, for the template but it continues to have issues with chat competition in tabbyapi.
I'm wondering if this is a problem with the tokenizer or if the model itself is the issue.
Can confirm it works fine on text completion, so.. hm.