Hugging Face's logo

Spaces:
MohamedRashad
/
arabic-tokenizers-leaderboard
Running

App Files Community
2
arabic-tokenizers-leaderboard

Commit History

Update README.md
dad693f
Running
verified

MohamedRashad commited on

Update README.md
810f57c
verified

MohamedRashad commited on

chore: Update leaderboard description and notes in app.py
8f88df6

MohamedRashad commited on

feat: Add Fertility Score calculation and Tokenize Tashkeel indicator to leaderboard description
d2eec13

MohamedRashad commited on

refactor: improve tokenization for Arabic text
d2e2dfe

MohamedRashad commited on

Add refresh functionality to update dataframe
0c0efc4

MohamedRashad commited on

Update app.py
e4cac44
verified

MohamedRashad commited on

Refactor tokenize_text function to include better tokenization for Arabic Text
a9aadc2

MohamedRashad commited on

Add sentencepiece to requirements.txt
0384cfb

MohamedRashad commited on

Refactor code and optimize dataframe sorting
6a52aab

MohamedRashad commited on

Update tokenization and visualization logic
62d4a12

MohamedRashad commited on

Add Arabic Tokenizers Leaderboard and Gradio Interface
203ba9b

MohamedRashad commited on

initial commit
1af62ac
verified

MohamedRashad commited on