Prompt Template for inference
#3
by
maharshipandya
- opened
What is the prompt template for inference? Is there any way to add system prompts?
Hi, the chat models use the ChatML format for inference.
Related code can be found at https://huggingface.co/Qwen/Qwen-7B-Chat-Int4/blob/main/modeling_qwen.py#L1186
It includes a default system message. The state for the support of system prompts are tracked at https://github.com/QwenLM/Qwen/issues/360
jklj077
changed discussion status to
closed