Upload tokenizer.model

#3
by emozilla - opened

Add the SentencePiece tokenizer, which is needed by some workflows/trainers

https://huggingface.co/mistralai/Mistral-7B-v0.1/blob/main/tokenizer.model

Thanks for the PR, approved! @emozilla

yinsong1986 changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment