AGT-0-primed / added_tokens.json
BoccheseGiacomo's picture
Upload tokenizer
4db3915 verified
raw
history blame contribute delete
41 Bytes
{
"<|et|>": 49153,
"<|th|>": 49152
}