Lineart controlnet

#11
by Pinkreact - opened

Can a line art control net work for flux

InstantX org

??

Line art is controlnet model on sd 1.5, it works well in sd. I was wondering if a model like that will exist for flux.

Hello, thanks for the good work you've done, it's great!
Are you planning to add the Flux-compatible Lineart controlnet model?

InstantX org

At present, there are no plans to implement lineart control. Personally, I think that Lineart and Canny are essentially the same thing. Value is not very significant.

Canny - Preprocessor uses the openCV canny edge detection to detect edges in an image. Generally used to get structure and details of an image.
Lineart - Preprocessor uses a model awacke1/Image-to-Line-Drawings to generate the map. Model can accept either images from the preprocessor or pure lineart to effectively color the lineart.

I believe it's not intended for the same use case. For instance, artists tend to prefer lineart over canny because it allows the generated output to precisely match their original drawings.
Maybe I can help to implement this? :D

Yes, line art model is what artist love to use because it keeps to the drawing.

The lineart models allow for much better sketch painting, relative to the regular canny one

Sign up or log in to comment