wavlm-base-plus_zh_tw_ver3 / tokenizer_config.json
christw16's picture
Update tokenizer_config.json
2b35764
raw
history blame
303 Bytes
{"bos_token": "<s>", "do_lower_case": false, "eos_token": "</s>", "model_max_length": 1000000000000000019884624838656, "pad_token": "[PAD]", "replace_word_delimiter_char": " ", "special_tokens_map_file": null, "tokenizer_class": "Wav2Vec2CTCTokenizer", "unk_token": "[UNK]", "word_delimiter_token": "|"}