Update README.md
Browse files
README.md
CHANGED
@@ -9,3 +9,27 @@ datasets:
|
|
9 |
- pls2000/aiart_channel_nai3_geachu
|
10 |
pipeline_tag: text-to-image
|
11 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
- pls2000/aiart_channel_nai3_geachu
|
10 |
pipeline_tag: text-to-image
|
11 |
---
|
12 |
+
|
13 |
+
## Training
|
14 |
+
|
15 |
+
Configuration refered from KBlueLeaf/Kohaku-XL-Zeta, using 2x3090 and sd-scripts.
|
16 |
+
|
17 |
+
### Command args
|
18 |
+
|
19 |
+
```
|
20 |
+
NCCL_P2P_DISABLE=1 NCCL_IB_DISABLE=1 accelerate launch --num_cpu_threads_per_process 4 sdxl_train.py \
|
21 |
+
--pretrained_model_name_or_path="/ai/data/sd/models/Stable-diffusion/Illustrious-XL-v0.1.safetensors" \
|
22 |
+
--dataset_config="arcaillous-xl.toml" \
|
23 |
+
--output_dir="results/ckpt" --output_name="arcaillous-xl" \
|
24 |
+
--save_model_as="safetensors" \
|
25 |
+
--gradient_accumulation_steps 64 \
|
26 |
+
--learning_rate=1e-5 --optimizer_type="Lion8bit" \
|
27 |
+
--lr_scheduler="constant_with_warmup" --lr_warmup_steps 100 --optimizer_args "weight_decay=0.01" "betas=0.9,0.95" --min_snr_gamma 5 \
|
28 |
+
--sdpa \
|
29 |
+
--no_half_vae \
|
30 |
+
--cache_latents --cache_latents_to_disk \
|
31 |
+
--gradient_checkpointing \
|
32 |
+
--full_bf16 --mixed_precision="bf16" --save_precision="bf16" \
|
33 |
+
--ddp_timeout=10000000 \
|
34 |
+
--max_train_epochs 4 --save_every_n_epochs 1 --save_every_n_steps 50 \
|
35 |
+
```
|