nvidia
/

Llama3-ChatQA-1.5-8B

Llama3-ChatQA-1.5-8B / tokenizer.json

The tokenizer adds a special token '<|im_end|>' to solve the problem of non-stop generation when encountering <|im_end|>.

a31949e verified about 2 months ago

9.08 MB

File too large to display, you can check the raw version instead.