leo1117 commited on
Commit
8afb852
1 Parent(s): 76add5a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -3
README.md CHANGED
@@ -1,3 +1,23 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ # TokenFlow🚀: Unified Image Tokenizer for Multimodal Understanding and Generation
6
+
7
+ <div align="center">
8
+
9
+ [![github repo](https://img.shields.io/badge/Github_repo-TokenFlow-green?logo=github)](https://github.com/ByteFlow-AI/TokenFlow)
10
+
11
+ </div>
12
+
13
+ ## 🌿 Introduction
14
+
15
+ We present TokenFlow, a unified image tokenizer that bridges the long-standing gap between multimodal understanding and generation.
16
+ TokenFlow introduce an innovative dual-codebook architecture that decouples semantic and pixel-level feature learning while maintaining their alignment through a shared mapping mechanism.
17
+
18
+ TokenFlow excels in both multimodal understanding and image generation. For multimodal understanding, we surpass the flagship models such as LLaVA-1.5 and EMU3 by a large margin. For text-to-image generation, we also achieve comparable performance to SDXL in 256×256 resolution.
19
+
20
+
21
+ ## ⚙️ Getting Started
22
+ This repo contains the model for text-to-image in TokenFlow.
23
+ See [GETTING_STARTED.md](https://github.com/ByteFlow-AI/TokenFlow/blob/main/GETTING_STARTED.md) for detailed instructions of ***training*** and ***evaluation*** of TokenFlow multimodal understanding.