Spaces:

xu-song
/

tokenizer-arena

Running

xu-song commited on Jul 13, 2024

Commit

70c093d

1 Parent(s): 47e1616

add doc

Files changed (1) hide show

compression_app.py CHANGED Viewed

@@ -142,7 +142,7 @@ with gr.Blocks(theme=theme) as demo:
             )
     gr.Markdown("## 🏆 Compression Rate Leaderboard\n"
-                "The leaderboard aim to evaluate tokenizer performance on different languages.\n"
                 "Lower `oov_ratio` refers to less out-of-vocabulary tokens.\n"
                 "Higher `char/token` means less words be segmented into subwords."
                 )

             )
     gr.Markdown("## 🏆 Compression Rate Leaderboard\n"
+                "The leaderboard aims to evaluate tokenizer performance on different languages.\n"
                 "Lower `oov_ratio` refers to less out-of-vocabulary tokens.\n"
                 "Higher `char/token` means less words be segmented into subwords."
                 )