clean_up_tokenization_spaces in tokenizer_config.json?
#3
by
fahadh4ilyas
- opened
Why the value that should be for bos_token is moved to clean_up_tokenization_spaces while the value for bos_token becomes empty string?