Spaces:

sunwaee
/

MT5-Questions-Answers-Generation-Extraction

Sleeping

App Files Files Community

MT5-Questions-Answers-Generation-Extraction / tokenizer /added_tokens.json

sunwaee's picture

added tokenizer (+ <hl>/<sep> tokens)

3143cf6 almost 3 years ago

33 Bytes

{"<hl>": 250100, "<sep>": 250101}