prokbert-mini / prokbert_tokenizer.py

Commit History

Updating ProkBert class and adding LCA tokenizer config
c677647

ligeti commited on

Tokenizer base
12bee07

Ligeti Balázs commited on