General training discoveries

#2
by CodeExplode - opened

Hi!

I'm just wondering if there are any general discoveries regarding training that the creators are willing to share? e.g. Does caption dropout seem to help? Did you settle on randomizing all tags or sometimes leave some at the front? (e.g. 1man, 1woman, etc)

Waifu Diffusion org

Most of our info is in the release notes. Partial caption dropout seems to work well, but we don't really have the resources to do a proper test. Tags are completely randomized. The training code is here if you want to see https://github.com/waifu-diffusion/network-trainer

CodeExplode changed discussion status to closed

Sign up or log in to comment