leo1117 commited on
Commit
134aa73
·
verified ·
1 Parent(s): b6a112c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -3
README.md CHANGED
@@ -1,3 +1,25 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ ---
4
+ # TokenFlow🚀: Unified Image Tokenizer for Multimodal Understanding and Generation
5
+
6
+ <div align="center">
7
+
8
+ [![TokenFlow](https://img.shields.io/badge/Paper-TokenFlow-2b9348.svg?logo=arXiv)](https://arxiv.org/abs/2412.03069)
9
+ [![huggingface weights](https://img.shields.io/badge/%F0%9F%A4%97%20Weights-TokenFlow-yellow)](https://huggingface.co/ByteFlow-AI)
10
+ [![project page](https://img.shields.io/badge/Project_page-More_visualizations-green?logo=bytedance)](https://byteflow-ai.github.io/TokenFlow/)
11
+
12
+ </div>
13
+
14
+
15
+ ## 🌿 Introduction
16
+
17
+ We present TokenFlow, a unified image tokenizer that bridges the long-standing gap between multimodal understanding and generation.
18
+ TokenFlow introduce an innovative dual-codebook architecture that decouples semantic and pixel-level feature learning while maintaining their alignment through a shared mapping mechanism.
19
+
20
+ TokenFlow excels in both multimodal understanding and image generation. For multimodal understanding, we surpass the flagship models such as LLaVA-1.5 and EMU3 by a large margin. For text-to-image generation, we also achieve comparable performance to SDXL in 256×256 resolution.
21
+
22
+
23
+ ## ⚙️ Getting Started
24
+
25
+ See [GETTING_STARTED.md](https://github.com/ByteFlow-AI/TokenFlow/blob/main/GETTING_STARTED.md) for detailed instructions of ***training*** and ***evaluation*** of TokenFlow tokenizer.