Commit
•
867909f
1
Parent(s):
a2b3e0f
Add PGT's files
Browse files- added_tokens.json +1 -0
added_tokens.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"<|sep|>": 50257, "<|pad|>": 50258, "[MASK]": 50259, "<|mask_sep|>": 50260}
|