Chatml?
#1
by
NakamotoSatoshiNASA
- opened
Does webui automatically pick the right instruct model? I see it says to pick Chatml but when I go and pick Chatml and load it it seems like it wasnt what was automatically loaded.
Not sure if I'm doing something wrong.
I checked the tokenizer config and a proper chat_template has been set, so if anything is going wrong I would suspect an issue on WebUI's side.
Thank you for the response! To be fair, I'm new to all this so I might just be mistaken and just don't understand what I'm doing. It's not something that only happens with this llm, it's every llm I load, so it's probably just me not understanding something.