add tokenizer files 2

Files changed (2) hide show

tokenizer.json CHANGED Viewed

The diff for this file is too large to render. See raw diff

tokenizer_config.json CHANGED Viewed

@@ -1,3 +1,3 @@
-{
-do_lower_case: true
-}

+{
+  "do_lower_case": true
+}