breakcore2 commited on
Commit
f090627
·
1 Parent(s): ce42a76

Update d-adaptation/notes.md

Browse files
Files changed (1) hide show
  1. d-adaptation/notes.md +3 -0
d-adaptation/notes.md CHANGED
@@ -2,6 +2,8 @@
2
 
3
  ## Learning rates
4
  Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
 
 
5
 
6
  ## Alpha
7
  Alpha=Dim was recommended in the github thread https://github.com/kohya-ss/sd-scripts/issues/181
@@ -23,6 +25,7 @@ Lower dims show good performance. Need much larger test to check for accuracy be
23
  512 resolution is good so far 700 steps.
24
  640 resolution is good. 900 steps. UMP has 640 resolution sample.
25
  768 resolution has not been doing well with the 1.0/0.5 LR, it melts. 0.5/0.25 LR worked out great with 750 steps.
 
26
 
27
  ## Steps
28
  600 to 800 steps have been the primary focus of experimentation.
 
2
 
3
  ## Learning rates
4
  Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
5
+ This rate did not work well for 768 training and for 640 required adjustments to scheduler to work better.
6
+ 0.5/0.25 unet/text worked on 512 resolution and 768.
7
 
8
  ## Alpha
9
  Alpha=Dim was recommended in the github thread https://github.com/kohya-ss/sd-scripts/issues/181
 
25
  512 resolution is good so far 700 steps.
26
  640 resolution is good. 900 steps. UMP has 640 resolution sample.
27
  768 resolution has not been doing well with the 1.0/0.5 LR, it melts. 0.5/0.25 LR worked out great with 750 steps.
28
+ 512 resolution held up well at 0.5/0.25 as well so this is looking like a better universal rate.
29
 
30
  ## Steps
31
  600 to 800 steps have been the primary focus of experimentation.