drama-1b / tokenizer.json

Tom Aarsen

Integrate Sentence Transformers, prevent manual tokenizer EOS

ac202b7 4 days ago

17.2 MB

This file is stored with Git LFS . It is too big to display, but you can still download it.

Git Large File Storage (LFS) replaces large files with text pointers inside Git, while storing the file contents on a remote server. More info.