KoichiYasuoka
/

deberta-base-ainu

Inference Endpoints

Model card Files Files and versions Community

KoichiYasuoka commited on Jan 17, 2023

Commit

1858124

•

1 Parent(s): 72eedb5

model improved

Files changed (1) hide show

tokenizer.json +7 -0

tokenizer.json CHANGED Viewed

@@ -749,6 +749,13 @@
         },
         "content": "r"
       },
       {
         "type": "Replace",
         "pattern": {

         },
         "content": "r"
       },
+      {
+        "type": "Replace",
+        "pattern": {
+          "String": "ー"
+        },
+        "content": "-"
+      },
       {
         "type": "Replace",
         "pattern": {