What's the correct chat template?

#3
by FrenzyBiscuit - opened

Running into issues with chat completion because the template is wrong.

Can you post the correct/fixed version for it?

Thanks!

Skyfall uses Metharme (Pygmalion in SillyTavern)

<system>sys msg<user>usr msg<assistant>ass msg

I've never messed with the tokenizer_config.json before, what would I need to replace in there for chat completion to work correctly?

I've tried to use a few of your other working models, such as cydonia v1, for the template but it continues to have issues with chat competition in tabbyapi.

I'm wondering if this is a problem with the tokenizer or if the model itself is the issue.

Can confirm it works fine on text completion, so.. hm.

Sign up or log in to comment