shuttie commited on
Commit
81bc81d
1 Parent(s): 80926a4

add tokenizer.json

Browse files
Files changed (2) hide show
  1. .gitattributes +2 -1
  2. tokenizer.json +3 -0
.gitattributes CHANGED
@@ -1,2 +1,3 @@
1
  *.onnx filter=lfs diff=lfs merge=lfs -text
2
- vocab.txt filter=lfs diff=lfs merge=lfs -text
 
 
1
  *.onnx filter=lfs diff=lfs merge=lfs -text
2
+ vocab.txt filter=lfs diff=lfs merge=lfs -text
3
+ tokenizer.json filter=lfs diff=lfs merge=lfs -text
tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:be50c3628f2bf5bb5e3a7f17b1f74611b2561a3a27eeab05e5aa30f411572037
3
+ size 466247