Trained for 5 epochs and 6500 steps.

Trained with datasets ['text-embeds', 'mj-v6']
Learning rate 8e-06, batch size 32, and 4 gradient accumulation steps.
Used DDPM noise scheduler for training with epsilon prediction type and rescaled_betas_zero_snr=False
Using 'trailing' timestep spacing.
Base model: PixArt-alpha/PixArt-Sigma-XL-2-1024-MS
VAE: madebyollin/sdxl-vae-fp16-fix

README.md

@@ -211,7 +211,7 @@ You may reuse the base model text encoder for inference.
 ## Training settings
 
 - Training epochs: 5
-- Training steps: 6000
+- Training steps: 6500
 - Learning rate: 8e-06
 - Effective batch size: 128
   - Micro-batch size: 32

optimizer.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:7d08e47990ad6d508f45b88b2496e7daaa7eea82b76f11ee99c0195ca99b173b
+oid sha256:44afaab9255d34407ccdda24cd8d439c1dc2c8b894626b73513c3f99f6884bca
 size 3665677155

random_states_0.pkl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ac2a70f0fdae2c02ec3f30c675b1515bdf570ab1a00bf1ec8c7bc7a539601cd8
+oid sha256:39e5379e888f59465cd27ed54de0dc30d2c13614d6c9fa9d9612180e9def4cc0
 size 14344

scheduler.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6416ba923469ed00c6a8a8d7f3f7db82be2a54e984ce3bb746f1dc05eefbf06f
+oid sha256:82b9181e0fb07684d448c29b119a12ece73f17e76cf041d9866d1abc21f0654b
 size 1000

training_state-mj-v6.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6da246c84235d608989a130620df4cba7ac97a6179b6737ce64d9bc400fbd3e2
-size 15545443
+oid sha256:1b27a20757ed8b206880c6c3b348d4aa502fbd6fc490aa67d90f0197f93a7a87
+size 20793443

training_state.json

@@ -1 +1 @@
-{"global_step": 6000, "epoch_step": 509, "epoch": 6, "exhausted_backends": [], "repeats": {"mj-v6": 0}}
+{"global_step": 6500, "epoch_step": 1009, "epoch": 6, "exhausted_backends": [], "repeats": {"mj-v6": 0}}

transformer/diffusion_pytorch_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:aca8751233ed7cdaf6516c28ad68998f3e6c0ecd68f34af305a4e139367580d2
+oid sha256:fa1de754981329845441044235df9d94a826cf2ee7a3f5b77f1de1c99c35014b
 size 1221780352