There are two instances of "clean up tokenization spaces" in the tokenizer_config.json

#14
by aw632 - opened

There are two instances of "clean up tokenization spaces" in the tokenizer_config.json, one True and one False. Which is correct?

Sign up or log in to comment