bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF · FYI - Ollama template that fixes the problem with the model outputting in Chinese instead of English

FYI for anyone looking for it, the official ollama template for DSCv2 is wrong and results in the model outputting Chinese instead of English.

The correct template is:

FROM ./DeepSeek-Coder-V2-Lite-Instruct-Q6_K_L.gguf

TEMPLATE """{{ if .System }}{{ .System }}

{{ end }}{{ if .Prompt }}User: {{ .Prompt }}

{{ end }}Assistant:{{ .Response }}<｜end▁of▁sentence｜>"""

PARAMETER stop "User:"
PARAMETER stop "Assistant:"
PARAMETER stop "<｜end▁of▁sentence｜>"

src: https://github.com/deepseek-ai/DeepSeek-Coder-V2/issues/12