SystemGemma2-2b-it / tokenizer.json

Commit History

Update tokenizer files (#7)
1b694f5
verified

Xenova HF staff commited on

Set `<start_of_turn` and `<end_of_turn>` to be special tokens (#2)
2b6ac3f
verified

Xenova HF staff commited on

Upload tokenizer
59b7de6
verified

osanseviero commited on