Transformers update warning

#37
by BBLL3456 - opened

Hi, Thanks a lot for the app. I had the following warning while loading:

"Loading the tokenizer from the special_tokens_map.json and the added_tokens.json will be removed in transformers 5, it is kept for forward compatibility, but it is recommended to update your tokenizer_config.json by uploading it again. You will see the new added_tokens_decoder attribute that will store the relevant information.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained."

Appreciate if you could look into this. Thanks in advance.

BBLL3456 changed discussion status to closed

Sign up or log in to comment