why lora preview images looks very different during training process when using cfg=1 and cfg=4?
#7
by
adwad
- opened
when training cfg=1 and validate cfg=3.5, the process looks like following. not really like the role i'm training but still a normal image.
when training cfg=4 and validate cfg=3.5, there are obvious noise when underfitting
new to lora, curious about that
What is the model used to generate the samples ? I'm not on the latest but I had to disable samples because they would come horrible systematically when training on de-distilled
First, the default setting was using only 20 steps where dedistilled needs at least 40.
Then there was no support for CFG > 4
Dedistilled is TERRIBLE when using CFG = 1. This looks close to it
You have to know what settings are used to generate the samples before concluding anything.