Repeating headers
#140
by
markemicek
- opened
For some reason, when I query this model, it always responds with repeating headers which ends up breaking the chat template. Is this a known issue?
Example output:
|start_header_id|><|start_header_id|><|start_header_id|>assistant<|end_header_id|>
Well, user error. don't forget to use add_generation_prompt=True when converting to chat template.
markemicek
changed discussion status to
closed