tokenizer missing?

#1
by bdambrosio - opened

I assume I can use the one from the stock mixtral repository?

Yes, apologies for any missing files, I'll add later. I made these conversions when Mistral AI had only published the .pt files in their repos and this is what the script generates. You can use their repo now (though they put both both the .pt files as well as the Transformers-compatible files together.)

Sign up or log in to comment