Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
5w4n
/
burmese-tokenizers
like
4
Runtime error
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
main
burmese-tokenizers
Commit History
Update chart
a57f878
5w4n
commited on
May 19, 2024
Add new sample button
f25131d
5w4n
commited on
May 19, 2024
Add cohere multilingual v3
bfa0a38
5w4n
commited on
May 19, 2024
Add cohere multilingual tokenizer
fc19172
5w4n
commited on
May 19, 2024
Add simbolo tokenizers
52f4fdb
5w4n
commited on
May 19, 2024
Add simbolo tokenizer
75515fa
5w4n
commited on
May 19, 2024
Update emoji
5dcfc72
5w4n
commited on
May 19, 2024
Update about the project
45abc63
5w4n
commited on
May 19, 2024
Add error handling for no tokenizer selected
9acdffa
5w4n
commited on
May 19, 2024
Add token distribution chart and token count variability
6841f1c
5w4n
commited on
May 19, 2024
Format the output
0158b9f
5w4n
commited on
May 19, 2024
Fix bug
3e67b95
5w4n
commited on
May 18, 2024
Make the code to use precalculated tokens from the dataset
34eb18c
5w4n
commited on
May 18, 2024
Move the token results from sidebar
116574f
5w4n
commited on
May 18, 2024
Update dataset
b1e9d2d
5w4n
commited on
May 18, 2024
Add requirements
397a76e
5w4n
commited on
May 18, 2024
Init
daa27ce
5w4n
commited on
May 18, 2024
Add dataset
238ae95
5w4n
commited on
May 18, 2024
initial commit
79a579c
verified
5w4n
commited on
May 18, 2024