eliebak
/

the-tokenizer-v2

Model card Files Files and versions Community

File size: 51 Bytes

4da8c10

{
  "<|im_end|>": 49153,
  "<|im_start|>": 49152
}