English
Autoregressive
Tokenizer
shifengyuan commited on
Commit
4a7d125
1 Parent(s): 8111589

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -3
README.md CHANGED
@@ -1,3 +1,18 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - Autoregressive
7
+ - Tokenizer
8
+ ---
9
+
10
+ ## Taming Scalable Visual Tokenizer for Autoregressive Image Generation
11
+ Code: https://github.com/TencentARC/SEED-Voken
12
+
13
+ Paper: https://arxiv.org/abs/2412.02692
14
+
15
+ This repo is used for hosting IBQ’s checkpoints.
16
+
17
+ ## Introduction
18
+ We propose Index Backpropagation Quantization (IBQ), a new vector quantization method for the joint optimization of all codebook embeddings and the visual encoder, ensuring the consistent latent space.  IBQ enables scalable training of visual tokenizers and, for the first time, achieves a large-scale codebook (2^18) with high dimension (256) and high utilization.