Text-to-Image
English
Bedovyy commited on
Commit
da1b6ee
·
verified ·
1 Parent(s): 5439a82

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -9,3 +9,27 @@ datasets:
9
  - pls2000/aiart_channel_nai3_geachu
10
  pipeline_tag: text-to-image
11
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
9
  - pls2000/aiart_channel_nai3_geachu
10
  pipeline_tag: text-to-image
11
  ---
12
+
13
+ ## Training
14
+
15
+ Configuration refered from KBlueLeaf/Kohaku-XL-Zeta, using 2x3090 and sd-scripts.
16
+
17
+ ### Command args
18
+
19
+ ```
20
+ NCCL_P2P_DISABLE=1 NCCL_IB_DISABLE=1 accelerate launch --num_cpu_threads_per_process 4 sdxl_train.py \
21
+ --pretrained_model_name_or_path="/ai/data/sd/models/Stable-diffusion/Illustrious-XL-v0.1.safetensors" \
22
+ --dataset_config="arcaillous-xl.toml" \
23
+ --output_dir="results/ckpt" --output_name="arcaillous-xl" \
24
+ --save_model_as="safetensors" \
25
+ --gradient_accumulation_steps 64 \
26
+ --learning_rate=1e-5 --optimizer_type="Lion8bit" \
27
+ --lr_scheduler="constant_with_warmup" --lr_warmup_steps 100 --optimizer_args "weight_decay=0.01" "betas=0.9,0.95" --min_snr_gamma 5 \
28
+ --sdpa \
29
+ --no_half_vae \
30
+ --cache_latents --cache_latents_to_disk \
31
+ --gradient_checkpointing \
32
+ --full_bf16 --mixed_precision="bf16" --save_precision="bf16" \
33
+ --ddp_timeout=10000000 \
34
+ --max_train_epochs 4 --save_every_n_epochs 1 --save_every_n_steps 50 \
35
+ ```