Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 2ccbe81 verified Angry-Wizard commited on Mar 1, 2024
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt 17c058c verified Angry-Wizard commited on Mar 1, 2024
Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json f61b548 verified Angry-Wizard commited on Mar 1, 2024
Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json 22580c4 verified Angry-Wizard commited on Mar 1, 2024