Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
levuloihust
/
vien-unigram-tokenizer
like
0
Vietnamese
English
arxiv:
1804.10959
Model card
Files
Files and versions
Community
main
vien-unigram-tokenizer
2 contributors
History:
3 commits
Le Vu Loi
add necessary assets
8a91069
about 1 year ago
.gitattributes
Safe
1.63 kB
add necessary assets
about 1 year ago
README.md
Safe
2.65 kB
Create README.md
about 1 year ago
added_tokens.json
Safe
99 Bytes
add necessary assets
about 1 year ago
nmt_nfkc_vidiacritic.tsv
Safe
8.56 MB
LFS
add necessary assets
about 1 year ago
required_chars.txt
Safe
680 Bytes
add necessary assets
about 1 year ago
special_tokens_map.json
Safe
170 Bytes
add necessary assets
about 1 year ago
spm.model
Safe
1.36 MB
LFS
add necessary assets
about 1 year ago
tokenizer_config.json
Safe
1.62 kB
add necessary assets
about 1 year ago
user_defined_symbols.txt
Safe
6.05 kB
add necessary assets
about 1 year ago
