Pixel-based Pre-training [EMNLP'24] [Autoregressive Pre-Training on Pixels and Texts](https://arxiv.org/pdf/2404.10710). Dual Modalities of Text: Visual and Textual Generative Pre-training Paper • 2404.10710 • Published Apr 16 baidu/DualGPT Text Generation • Updated Oct 4 • 11 • 2 baidu/MonoGPT Text Generation • Updated Oct 4 • 11 • 2 baidu/PixelGPT Text Generation • Updated Oct 4 • 9 • 2
Dual Modalities of Text: Visual and Textual Generative Pre-training Paper • 2404.10710 • Published Apr 16
Multilingual Code Pre-training [ACL'23 Findings] ERNIE-Code, the First multilingual text and multlingual code pre-training. ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages Paper • 2212.06742 • Published Dec 13, 2022 • 2 baidu/ernie-code-560m Text2Text Generation • Updated Oct 4 • 18 • 7
ERNIE-Code: Beyond English-Centric Cross-lingual Pretraining for Programming Languages Paper • 2212.06742 • Published Dec 13, 2022 • 2
