Rename tokenizer.tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json a04317d verified Yntec commited on Nov 9, 2024
Rename tokenizer.tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 504deb3 verified Yntec commited on Nov 9, 2024