francescopatane's picture
Upload tokenizer
88fec06
raw
history blame
93 Bytes
<cls>
<pad>
<eos>
<unk>
L
A
G
V
S
E
R
T
I
D
P
K
Q
N
F
Y
M
H
W
C
X
B
U
Z
O
.
-
<null_1>
<mask>