Koboldcpp warning: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect (

#1
by lightning-missile - opened

Hi,

I am testing out the Q8_0 using koboldcpp. The model ran fine, but I see this output from the terminal:

llm_load_vocab: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect

What does this warning/error mean? Does this have an impact on the model quality?
Thanks!

Sign up or log in to comment