heuristic_shannon / added_tokens.json
tomekkorbak's picture
Training in progress, step 25354
0b4f056
raw
history blame
54 Bytes
{
"<|aligned|>": 50257,
"<|misaligned|>": 50258
}