LoneStriker

/

deepseek-coder-33b-instruct-5.0bpw-h6-exl2

like 1

The chat_template and eos_token don't match so it will repeat EOT unless you set a custom stopping string or apply a fix, e.g.: https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct/discussions/5/files
I see that in the CodeFuse repos this is fixed by referencing the eos_token in the chat_template.

Not sure if anyone (still?) uses this but in case anyone else runs into it this might save some time.