1TuanPham's picture
Upload tokenizer
8eae034 verified
raw
history blame
152 Bytes
{
"[/Assistant]": 38369,
"[/SYSMSG]": 38366,
"[/USER]": 38368,
"[Assistant]": 38370,
"[PAD]": 38371,
"[SYSMSG]": 38365,
"[USER]": 38367
}