c4ai-command-r-v01-tokenizer / tokenizer_config.json

Commit History

Update tokenizer_config.json (#3)
6f38b9f
verified

nsarrazin HF staff commited on

Update tokenizer_config.json
b39fcad
verified

nsarrazin HF staff commited on

Update tokenizer_config.json (#2)
8149df4
verified

nsarrazin HF staff commited on

add system messages to tokenizer
6c5535a
unverified

nsarrazin HF staff commited on

Remove BOS from chat template
418f7ef

nsarrazin HF staff commited on

Upload 2 files
93b7f20
verified

Xenova HF staff commited on