Training inpainting discussion
As I know, may be it not correct yet. I currently having an issue as:
I want to train some specific style of image ( my custom style ) using DreamBooth on stable-diffusion model runwayml/stable-diffusion-v1-5, it worked, but the issue here is i want to use this model "stabilityai/stable-diffusion-2-inpainting" to train custom styles as stable-diffusion-v1-5. But I could not find the way to fine-tune that inpainting model. I have try to merged these models for my use case but there was difference in the param shape of text_model from inpainting is different from normal stable diffusion model.
Is there any solution to train new styles using inpainting model or is there a method to merge these two model for my purpose ?
If there is anything not clear yet, please feel free to leave a message i will clarify that
Thank you,
m
As I know, may be it not correct yet. I currently having an issue as:
...
Is there any solution to train new styles using inpainting model or is there a method to merge these two model for my purpose ?
If there is anything not clear yet, please feel free to leave a message i will clarify that
Thank you,
So If I get your goal correctly, you want an inpainting file for your newly finetuned checkpoint (You sucessfully finetuned checkpoint on style you want and want a proper inpainting to go with it)? If that was the case, use method I link below to get that.
To ensure you still see the steps I will paste it here (in the case IF original reddit post got deleted or something else, but check the reddit post first because it contain more info and further discussions about the method)
1 Go to Checkpoint Merger in AUTOMATIC1111 webui
2 Set model A to "sd-1.5-inpainting" model ( https://huggingface.co/runwayml/stable-diffusion-inpainting )
3 Set model B to any model you want
4 Set model C to "v1.5-pruned" model ( https://huggingface.co/runwayml/stable-diffusion-v1-5 )
5 Set Multiplier to 1
6 Choose "Add difference" Interpolation method
7 Make sure your model has the "-inpainting" part at the end of its name (Anything3-inpainting, DreamLike-inpainting, etc.)