Commit
·
b3aed37
1
Parent(s):
9fe6e15
Update d-adaptation/notes.md
Browse files- d-adaptation/notes.md +2 -0
d-adaptation/notes.md
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
# D-Adaptation Experiment Notes
|
| 2 |
|
|
|
|
|
|
|
| 3 |
## Learning rates
|
| 4 |
Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
|
| 5 |
This rate did not work well for 768 training and for 640 required adjustments to scheduler to work better.
|
|
|
|
| 1 |
# D-Adaptation Experiment Notes
|
| 2 |
|
| 3 |
+
using decouple=true and weight_decay=0.6 in optimizer args.
|
| 4 |
+
|
| 5 |
## Learning rates
|
| 6 |
Unet 1, text 0.5 as seen in thread: https://twitter.com/kohya_tech/status/1627194651034943490?cxt=HHwWhIDUtb66-pQtAAAA
|
| 7 |
This rate did not work well for 768 training and for 640 required adjustments to scheduler to work better.
|