FP8 or NF4 version
#8
by
GeroldMeisinger
- opened
I just tried the ComfyUI implementation and it works great but the memory requirements are quite high. with flux barely fitting in 16GB vram this controlnet is too much. could you also add a fp8 version (or better yet a nf4 version) please.
GeroldMeisinger
changed discussion title from
FP8 version
to FP8 or NF4 version
I think a GGUF version would be also great.
I did not manage to get it running on 16gb VRAM unfortunately. Q4.1.gguf model and T5xxl_fp8 were not enough to run it
install xformers and try smaller images (512x512)
install xformers and try smaller images (512x512)
What's the point of using Flux if you're creating such small images, though? 🤷🏼