XCLiu commited on
Commit
30711e9
1 Parent(s): bf8151d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +105 -5
README.md CHANGED
@@ -1,5 +1,105 @@
1
- ---
2
- license: other
3
- license_name: tencent-hunyuan-community
4
- license_link: https://huggingface.co/Tencent-Hunyuan/HunyuanDiT/blob/main/LICENSE.txt
5
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: tencent-hunyuan-community
4
+ license_link: https://huggingface.co/Tencent-Hunyuan/HunyuanDiT/blob/main/LICENSE.txt
5
+ language:
6
+ - en
7
+ ---
8
+ <!-- ## **HunyuanDiT** -->
9
+
10
+ <p align="center">
11
+ <img src="https://raw.githubusercontent.com/Tencent/HunyuanDiT/main/asset/logo.png" height=100>
12
+ </p>
13
+
14
+ # Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding
15
+ # 混元-DiT: 具有细粒度中文理解的多分辨率Diffusion Transformer
16
+
17
+ [[Arxiv]](https://arxiv.org/abs/2405.08748) [[project page]](https://dit.hunyuan.tencent.com/) [[github]](https://github.com/Tencent/HunyuanDiT)
18
+
19
+ This repo contains the pre-trained text-to-image model in 🤗 [Diffusers](https://github.com/huggingface/diffusers) format.
20
+
21
+ ## Dependency
22
+ Please install PyTorch first, following the instruction in [https://pytorch.org](https://pytorch.org)
23
+
24
+ Install the latest version of transformers with `pip`:
25
+ ```
26
+ pip install --upgrade transformers
27
+ ```
28
+
29
+ Then install the latest github version of 🤗 Diffusers with `pip`:
30
+ ```
31
+ pip install git+https://github.com/huggingface/diffusers.git
32
+ ```
33
+
34
+ ## Example Usage with 🤗 Diffusers
35
+ ```py
36
+ import torch
37
+ from diffusers import HunyuanDiTPipeline
38
+
39
+ pipe = HunyuanDiTPipeline.from_pretrained("Tencent-Hunyuan/HunyuanDiT-v1.1-Diffusers", torch_dtype=torch.float16)
40
+ pipe.to("cuda")
41
+
42
+ # You may also use English prompt as HunyuanDiT supports both English and Chinese
43
+ # prompt = "An astronaut riding a horse"
44
+ prompt = "一个宇航员在骑马"
45
+ image = pipe(prompt).images[0]
46
+ ```
47
+
48
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/646b0bbdec9a61e871799339/xoO_-5N7eZ-aCt4KpBYY6.png)
49
+
50
+ ## 📈 Comparisons
51
+ In order to comprehensively compare the generation capabilities of HunyuanDiT and other models, we constructed a 4-dimensional test set, including Text-Image Consistency, Excluding AI Artifacts, Subject Clarity, Aesthetic. More than 50 professional evaluators performs the evaluation.
52
+
53
+ <p align="center">
54
+ <table>
55
+ <thead>
56
+ <tr>
57
+ <th rowspan="2">Model</th> <th rowspan="2">Open Source</th> <th>Text-Image Consistency (%)</th> <th>Excluding AI Artifacts (%)</th> <th>Subject Clarity (%)</th> <th rowspan="2">Aesthetics (%)</th> <th rowspan="2">Overall (%)</th>
58
+ </tr>
59
+ </thead>
60
+ <tbody>
61
+ <tr>
62
+ <td>SDXL</td> <td> ✔ </td> <td>64.3</td> <td>60.6</td> <td>91.1</td> <td>76.3</td> <td>42.7</td>
63
+ </tr>
64
+ <tr>
65
+ <td>PixArt-α</td> <td> ✔</td> <td>68.3</td> <td>60.9</td> <td>93.2</td> <td>77.5</td> <td>45.5</td>
66
+ </tr>
67
+ <tr>
68
+ <td>Playground 2.5</td> <td>✔</td> <td>71.9</td> <td>70.8</td> <td>94.9</td> <td>83.3</td> <td>54.3</td>
69
+ </tr>
70
+
71
+ <tr>
72
+ <td>SD 3</td> <td>&#10008</td> <td>77.1</td> <td>69.3</td> <td>94.6</td> <td>82.5</td> <td>56.7</td>
73
+
74
+ </tr>
75
+ <tr>
76
+ <td>MidJourney v6</td><td>&#10008</td> <td>73.5</td> <td>80.2</td> <td>93.5</td> <td>87.2</td> <td>63.3</td>
77
+ </tr>
78
+ <tr>
79
+ <td>DALL-E 3</td><td>&#10008</td> <td>83.9</td> <td>80.3</td> <td>96.5</td> <td>89.4</td> <td>71.0</td>
80
+ </tr>
81
+ <tr style="font-weight: bold; background-color: #f2f2f2;">
82
+ <td>Hunyuan-DiT</td><td>✔</td> <td>74.2</td> <td>74.3</td> <td>95.4</td> <td>86.6</td> <td>59.0</td>
83
+ </tr>
84
+ </tbody>
85
+ </table>
86
+ </p>
87
+
88
+ ## 🎥 Visualization
89
+
90
+ * **Chinese Elements**
91
+ <p align="center">
92
+ <img src="https://raw.githubusercontent.com/Tencent/HunyuanDiT/main/asset/chinese elements understanding.png" height=220>
93
+ </p>
94
+
95
+ * **Long Text Input**
96
+
97
+
98
+ <p align="center">
99
+ <img src="https://raw.githubusercontent.com/Tencent/HunyuanDiT/main/asset/long text understanding.png" height=310>
100
+ </p>
101
+
102
+
103
+ ## 🔥🔥🔥 Tencent Hunyuan Bot
104
+
105
+ Welcome to [Tencent Hunyuan Bot](https://hunyuan.tencent.com/bot/chat), where you can explore our innovative products in multi-round conversation!