line-corporation
/

line-distilbert-base-japanese

Model card Files Files and versions Community

line-distilbert-base-japanese / distilbert_japanese_tokenizer.py

Commit History

Update distilbert_japanese_tokenizer.py (#4)

93bd481

liwii commited on Dec 1, 2023

Allow only unidic_lite (#2)

bcbdf6d

kajyuuen commited on Mar 22, 2023

Improve tokenizers (#1)

1220bcd

kajyuuen commited on Mar 22, 2023

Initial commit

a7345ac

kajyuuen commited on Mar 10, 2023