Remove ` "add_special_tokens"` tokenizer config key
#2
by
jcrpaquin-cfa
- opened
"add_special_tokens" now conflicts with a method of the same name in the Transformers library, preventing successful deserialization of the model. The behavior of the model, leading up to the breaking change, was not impacted by this config key.
jcrpaquin-cfa
changed pull request status to
merged