---
title: Tokenizer
emoji: 👀
colorFrom: indigo
colorTo: pink
sdk: gradio
sdk_version: 3.28.3
app_file: app.py
pinned: false
license: mit
---

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference

This repo is a copy of https://github.com/BOUN-TABILab-TULAP/tokenizer.