Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,83 @@
|
|
1 |
---
|
2 |
license: creativeml-openrail-m
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: creativeml-openrail-m
|
3 |
+
tags:
|
4 |
+
- text-to-image
|
5 |
+
- stable-diffusion
|
6 |
+
- diffusers
|
7 |
---
|
8 |
+
|
9 |
+
# AnimeBoysXL
|
10 |
+
|
11 |
+
**It takes substantial time and efforts to bake models. If you appreciate my models, I would be grateful if you could support me on [Ko-fi](https://ko-fi.com/koolchh) ☕.**
|
12 |
+
|
13 |
+
## Features
|
14 |
+
|
15 |
+
- ✔️ **Good for inference**: AnimeBoysXL is a flexible model which is good at generating images of anime boys and males-only content in a wide range of styles.
|
16 |
+
- ✔️ **Good for training**: AnimeBoysXL is suitable for further training, thanks to its neutral style and ability to recognize a great deal of concepts. Feel free to train your own anime boy model/LoRA from AnimeBoysXL.
|
17 |
+
- ❌ AnimeBoysXL is not optimized for creating anime girls. Please consider using other models for that purpose.
|
18 |
+
|
19 |
+
## Inference Guide
|
20 |
+
|
21 |
+
- **Prompt**: Use tag-based prompts to describe your subject.
|
22 |
+
- Append `, best quality, amazing quality, best aesthetic, absurdres` to the prompt to improve image quality.
|
23 |
+
- (*Optional*) Append `, year YYYY` to the prompt to shift the output toward the prevalent style of that year. `YYYY` is a 4 digit year, e.g. `, year 2023`
|
24 |
+
- **Negative prompt**: Choose from one of the following two presets.
|
25 |
+
1. Heavy (*recommended*): `lowres, (bad:1.05), text, error, missing, extra, fewer, cropped, jpeg artifacts, worst quality, bad quality, watermark, bad aesthetic, unfinished, chromatic aberration, scan, scan artifacts, 1girl, breasts`
|
26 |
+
2. Light: `lowres, jpeg artifacts, worst quality, watermark, blurry, bad aesthetic, 1girl, breasts`
|
27 |
+
- (*Optional*) Add `, realistic, lips, nose` to the negative prompt if you need a flat anime-like style.
|
28 |
+
- **VAE**: Make sure you're using [SDXL VAE](https://huggingface.co/stabilityai/sdxl-vae/tree/main).
|
29 |
+
- **Sampling method, sampling steps and CFG scale**: I find **(Euler a, 28, 5)** good. You are encouraged to experiment with other settings.
|
30 |
+
- **Width and height**: **832*1216** for portrait, **1024*1024** for square, and **1216*832** for landscape.
|
31 |
+
|
32 |
+
## Training Details
|
33 |
+
|
34 |
+
AnimeBoysXL is trained from [Stable Diffusion XL Base 1.0](https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0), on ~516k images.
|
35 |
+
|
36 |
+
The following tags are attached to the training data to make it easier to steer toward either more aesthetic or more flexible results.
|
37 |
+
|
38 |
+
### Quality tags
|
39 |
+
|
40 |
+
| tag | score |
|
41 |
+
|-------------------|------------|
|
42 |
+
| `best quality` | >= 150 |
|
43 |
+
| `amazing quality` | [100, 150) |
|
44 |
+
| `great quality` | [75, 100) |
|
45 |
+
| `normal quality` | [0, 75) |
|
46 |
+
| `bad quality` | (-5, 0) |
|
47 |
+
| `worst quality` | <= -5 |
|
48 |
+
|
49 |
+
### Aesthetic tags
|
50 |
+
|
51 |
+
| tag | score |
|
52 |
+
|--------------------|--------------|
|
53 |
+
| `best aesthetic` | >= 6.675 |
|
54 |
+
| `great aesthetic` | [6.0, 6.675) |
|
55 |
+
| `normal aesthetic` | [5.0, 6.0) |
|
56 |
+
| `bad aesthetic` | < 5.0 |
|
57 |
+
|
58 |
+
### Rating tags
|
59 |
+
|
60 |
+
| tag | rating |
|
61 |
+
|-----------------|--------------|
|
62 |
+
| (None) | general |
|
63 |
+
| `slightly nsfw` | sensitive |
|
64 |
+
| `fairly nsfw` | questionable |
|
65 |
+
| `very nsfw` | explicit |
|
66 |
+
|
67 |
+
### Year tags
|
68 |
+
|
69 |
+
year YYYY where YYYY is in the range of [2005, 2023].
|
70 |
+
|
71 |
+
### Training configurations
|
72 |
+
|
73 |
+
- Hardware: 4 * Nvidia A100 80GB GPUs
|
74 |
+
- Optimizer: AdaFactor
|
75 |
+
- Gradient accumulation steps: 8
|
76 |
+
- Batch size: 4 * 8 * 4 = 128
|
77 |
+
- Learning rates:
|
78 |
+
- 8e-6 for U-Net
|
79 |
+
- 5.2e-6 for text encoder 1 (CLIP ViT-L)
|
80 |
+
- 4.8e-6 for text encoder 2 (OpenCLIP ViT-bigG)
|
81 |
+
- Learning rate schedule: constant with 250 warmup steps
|
82 |
+
- Mixed precision training type: BF16
|
83 |
+
- Epochs: 20
|