01-ai

/

Yi-6B-Chat

like 62

Currently, the tokenizer uses the wrongbos and eos tokens. Users have to use a stop string to end the conversation.

@mzbac Thank you for your submission. After our internal discussion, we unanimously believe that there is no need to change this.

Just note that packages like vllm rely on bos_token and eos_token (see https://github.com/vllm-project/vllm/issues/1917). So we'd better fix it here.