Commit
·
f9d54ce
1
Parent(s):
5d7dfe8
Update README.md
Browse files
README.md
CHANGED
@@ -8,12 +8,17 @@ tags:
|
|
8 |
- stable-diffusion
|
9 |
- disco-diffusion
|
10 |
- art
|
|
|
11 |
inference: true
|
|
|
12 |
---
|
13 |
## Paint Journey V2 is [Paint Journey V1](https://huggingface.co/FredZhang7/paint-journey-v1) fine-tuned on 768x768 oil paintings by Midjourney, Open Journey, and Disco Diffusion
|
14 |
|
15 |
To apply the oil paint effect, begin the prompt with **((oil painting))**. For starters, try using a dimension of 768x768 for any subject, 512x768 for portraits, and 1152x768 for landscapes.
|
16 |
|
|
|
|
|
|
|
17 |
To further improve the resolution and reduce noise in generated images, especially when using the model for img2img, use [Paint Journey VAE](./paint_journey_v2.vae.pt) in combination with [Checkpoint](./paint_journey_v2.ckpt).
|
18 |
As an example, a Automatic1111's WebUI user can add both of these files to the `./stable-diffusion-webui/models/Stable-diffusion` folder.
|
19 |
|
@@ -44,6 +49,9 @@ As an example, a Automatic1111's WebUI user can add both of these files to the `
|
|
44 |
|
45 |
Prompts from top to bottom:
|
46 |
|
|
|
|
|
|
|
47 |
```
|
48 |
((oil painting)), portrait of a cute attractive model, ((round pupil)), smirk, ((beautiful eyes)), high resolution, uhd wallpaper
|
49 |
Negative prompt: low-res blurry fog mutated body ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
|
@@ -90,6 +98,8 @@ Negative prompt: low-res blurry ((fog)) watermark
|
|
90 |
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4009095562, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
|
91 |
```
|
92 |
|
|
|
|
|
93 |
## Automatic1111's WebUI
|
94 |
```
|
95 |
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
|
@@ -107,7 +117,7 @@ import torch
|
|
107 |
pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v2")
|
108 |
pipe = pipe.to("cuda")
|
109 |
|
110 |
-
prompt = "((oil painting)), a boat sailing, night sky, high resolution, uhd wallpaper"
|
111 |
image = pipe(prompt).images[0]
|
112 |
|
113 |
image.save("./result.png")
|
|
|
8 |
- stable-diffusion
|
9 |
- disco-diffusion
|
10 |
- art
|
11 |
+
- arxiv:2208.12242
|
12 |
inference: true
|
13 |
+
library_name: diffusers
|
14 |
---
|
15 |
## Paint Journey V2 is [Paint Journey V1](https://huggingface.co/FredZhang7/paint-journey-v1) fine-tuned on 768x768 oil paintings by Midjourney, Open Journey, and Disco Diffusion
|
16 |
|
17 |
To apply the oil paint effect, begin the prompt with **((oil painting))**. For starters, try using a dimension of 768x768 for any subject, 512x768 for portraits, and 1152x768 for landscapes.
|
18 |
|
19 |
+
Instead of solely fine-tuning its Unet, Paint Journey V2 focuses on fine-tuning its text encoder with a diverse range of prompts.
|
20 |
+
This allows for a seamless blend of the oil painting style into various other types of prompts, resulting in a more natural and dynamic output.
|
21 |
+
|
22 |
To further improve the resolution and reduce noise in generated images, especially when using the model for img2img, use [Paint Journey VAE](./paint_journey_v2.vae.pt) in combination with [Checkpoint](./paint_journey_v2.ckpt).
|
23 |
As an example, a Automatic1111's WebUI user can add both of these files to the `./stable-diffusion-webui/models/Stable-diffusion` folder.
|
24 |
|
|
|
49 |
|
50 |
Prompts from top to bottom:
|
51 |
|
52 |
+
<details>
|
53 |
+
<summary> Click to expand </summary>
|
54 |
+
|
55 |
```
|
56 |
((oil painting)), portrait of a cute attractive model, ((round pupil)), smirk, ((beautiful eyes)), high resolution, uhd wallpaper
|
57 |
Negative prompt: low-res blurry fog mutated body ((duplicate)) ((double head)) ((long neck)) ((extra eyes)) error ((extra fingers)) long face long body ((watermark)) signature
|
|
|
98 |
Steps: 20, Sampler: Euler, CFG scale: 7.5, Seed: 4009095562, Size: 1056x768, Model hash: 26fd2f6f, Batch size: 4, Batch pos: 0
|
99 |
```
|
100 |
|
101 |
+
</details>
|
102 |
+
|
103 |
## Automatic1111's WebUI
|
104 |
```
|
105 |
git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
|
|
|
117 |
pipe = StableDiffusionPipeline.from_pretrained("FredZhang7/paint-journey-v2")
|
118 |
pipe = pipe.to("cuda")
|
119 |
|
120 |
+
prompt = "((oil painting)), a boat sailing, night sky, high resolution, uhd, 4 k wallpaper"
|
121 |
image = pipe(prompt).images[0]
|
122 |
|
123 |
image.save("./result.png")
|