SystemGemma2-2b-it / tokenizer_config.json

Commit History

Set `<start_of_turn` and `<end_of_turn>` to be special tokens (#2)
2b6ac3f
verified

Xenova HF staff commited on

Update tokenizer_config.json
d8d6c73
verified

osanseviero commited on

Upload tokenizer
59b7de6
verified

osanseviero commited on