Spaces:
Running
on
Zero
Running
on
Zero
Leimingkun
commited on
Commit
β’
9e0a8d1
1
Parent(s):
835dcb7
pillow_heif
Browse files- app.py +15 -1
- requirements.txt +2 -1
app.py
CHANGED
@@ -11,6 +11,10 @@ from diffusers import (
|
|
11 |
StableDiffusionXLPipeline,
|
12 |
)
|
13 |
from ip_adapter import StyleStudio_Adapter
|
|
|
|
|
|
|
|
|
14 |
|
15 |
device = "cuda" if torch.cuda.is_available() else "cpu"
|
16 |
dtype = torch.float16 if str(device).__contains__("cuda") else torch.float32
|
@@ -162,6 +166,7 @@ Advanced usage:<br>
|
|
162 |
2. Choose different guidance and steps.
|
163 |
3. Set the timing for the Teacher Model's participation.
|
164 |
4. Feel free to discontinue using the Cross-Modal AdaIN and the Teacher Model for result comparison.
|
|
|
165 |
"""
|
166 |
|
167 |
article = r"""
|
@@ -171,13 +176,22 @@ article = r"""
|
|
171 |
1. As the value of end_fusion <b>increases</b>, the style gradually diminishes.
|
172 |
Therefore, it is suggested to set end_fusion to be between <b>1/5 and 1/3</b> of the number of inference steps (num inference steps).
|
173 |
2. If you want to experience style-based CFG, see the details on the <a href="https://github.com/Westlake-AGI-Lab/StyleStudio">GitHub repo</a>.
|
|
|
174 |
|
175 |
---
|
176 |
π **Citation**
|
177 |
<br>
|
178 |
If our work is helpful for your research or applications, please cite us via:
|
179 |
```bibtex
|
180 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
181 |
```
|
182 |
π§ **Contact**
|
183 |
<br>
|
|
|
11 |
StableDiffusionXLPipeline,
|
12 |
)
|
13 |
from ip_adapter import StyleStudio_Adapter
|
14 |
+
import pillow_heif
|
15 |
+
|
16 |
+
pillow_heif.register_heif_opener()
|
17 |
+
pillow_heif.register_avif_opener()
|
18 |
|
19 |
device = "cuda" if torch.cuda.is_available() else "cpu"
|
20 |
dtype = torch.float16 if str(device).__contains__("cuda") else torch.float32
|
|
|
166 |
2. Choose different guidance and steps.
|
167 |
3. Set the timing for the Teacher Model's participation.
|
168 |
4. Feel free to discontinue using the Cross-Modal AdaIN and the Teacher Model for result comparison.
|
169 |
+
5. β° We recommend uploading images in <b>JPEG</b> or <b>PNG</b> format.
|
170 |
"""
|
171 |
|
172 |
article = r"""
|
|
|
176 |
1. As the value of end_fusion <b>increases</b>, the style gradually diminishes.
|
177 |
Therefore, it is suggested to set end_fusion to be between <b>1/5 and 1/3</b> of the number of inference steps (num inference steps).
|
178 |
2. If you want to experience style-based CFG, see the details on the <a href="https://github.com/Westlake-AGI-Lab/StyleStudio">GitHub repo</a>.
|
179 |
+
3. For the purpose of comparing various results, it is possible to do so by switching off the cross-modal AdaIN and the Teacher Model.
|
180 |
|
181 |
---
|
182 |
π **Citation**
|
183 |
<br>
|
184 |
If our work is helpful for your research or applications, please cite us via:
|
185 |
```bibtex
|
186 |
+
@misc{lei2024stylestudiotextdrivenstyletransfer,
|
187 |
+
title={StyleStudio: Text-Driven Style Transfer with Selective Control of Style Elements},
|
188 |
+
author={Mingkun Lei and Xue Song and Beier Zhu and Hao Wang and Chi Zhang},
|
189 |
+
year={2024},
|
190 |
+
eprint={2412.08503},
|
191 |
+
archivePrefix={arXiv},
|
192 |
+
primaryClass={cs.CV},
|
193 |
+
url={https://arxiv.org/abs/2412.08503},
|
194 |
+
}
|
195 |
```
|
196 |
π§ **Contact**
|
197 |
<br>
|
requirements.txt
CHANGED
@@ -15,4 +15,5 @@ insightface
|
|
15 |
gradio
|
16 |
controlnet_aux
|
17 |
gdown
|
18 |
-
peft
|
|
|
|
15 |
gradio
|
16 |
controlnet_aux
|
17 |
gdown
|
18 |
+
peft
|
19 |
+
pillow_heif
|