Can you upload the tokenizer to the model directory?
#2
by
TheBloke
- opened
It's a little inconvenient for various third party libraries not to have a tokenizer included with the model.
It'd be great if you'd consider including the tokenizer files with the model, rather than requiring a separate repository for them.
The model looks amazing - thanks for uploading it! I'm doing quantisations now.
Hello, thanks for your comment! Our tokenizer has now been added to the model repo.
ohallstrom
changed discussion status to
closed