Stop tokens

by isr431 - opened Oct 22

Oct 22

Hi, thanks for creating this model! I'm creating an Ollama modelfile for it. Can you please tell me what are the stop tokens I should set for this model?

lucyknada

Anthracite org Oct 22

https://huggingface.co/anthracite-org/magnum-v4-9b-exl2/blob/3.0bpw/generation_config.json
eos is <|im_end|>

lucyknada changed discussion status to closed Oct 22

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment