Commit
·
f090627
1
Parent(s):
ce42a76
Update d-adaptation/notes.md
Browse files- d-adaptation/notes.md +3 -0
d-adaptation/notes.md
CHANGED
@@ -2,6 +2,8 @@
|
|
2 |
|
3 |
## Learning rates
|
4 |
Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
|
|
|
|
|
5 |
|
6 |
## Alpha
|
7 |
Alpha=Dim was recommended in the github thread https://github.com/kohya-ss/sd-scripts/issues/181
|
@@ -23,6 +25,7 @@ Lower dims show good performance. Need much larger test to check for accuracy be
|
|
23 |
512 resolution is good so far 700 steps.
|
24 |
640 resolution is good. 900 steps. UMP has 640 resolution sample.
|
25 |
768 resolution has not been doing well with the 1.0/0.5 LR, it melts. 0.5/0.25 LR worked out great with 750 steps.
|
|
|
26 |
|
27 |
## Steps
|
28 |
600 to 800 steps have been the primary focus of experimentation.
|
|
|
2 |
|
3 |
## Learning rates
|
4 |
Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
|
5 |
+
This rate did not work well for 768 training and for 640 required adjustments to scheduler to work better.
|
6 |
+
0.5/0.25 unet/text worked on 512 resolution and 768.
|
7 |
|
8 |
## Alpha
|
9 |
Alpha=Dim was recommended in the github thread https://github.com/kohya-ss/sd-scripts/issues/181
|
|
|
25 |
512 resolution is good so far 700 steps.
|
26 |
640 resolution is good. 900 steps. UMP has 640 resolution sample.
|
27 |
768 resolution has not been doing well with the 1.0/0.5 LR, it melts. 0.5/0.25 LR worked out great with 750 steps.
|
28 |
+
512 resolution held up well at 0.5/0.25 as well so this is looking like a better universal rate.
|
29 |
|
30 |
## Steps
|
31 |
600 to 800 steps have been the primary focus of experimentation.
|