benjamin commited on
Commit
c16112d
1 Parent(s): 1d0f7d6

update tokenizer

Browse files
Files changed (1) hide show
  1. tokenizer.json +2 -2
tokenizer.json CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9a98b5b40b349570c71c6dcb314dc4b1c1140a9d55f20c39160123a6dce1a8f5
3
- size 18119343
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c0bf0e5864f20edd35ac3f84004a2d4cd403c8a6c7fa9be6c3f76543b8bf556
3
+ size 18119713