FireFlow: Fast Inversion of Rectified Flow for Image Semantic Editing
Abstract
Though Rectified Flows (ReFlows) with distillation offers a promising way for fast sampling, its fast inversion transforms images back to structured noise for recovery and following editing remains unsolved. This paper introduces FireFlow, a simple yet effective zero-shot approach that inherits the startling capacity of ReFlow-based models (such as FLUX) in generation while extending its capabilities to accurate inversion and editing in 8 steps. We first demonstrate that a carefully designed numerical solver is pivotal for ReFlow inversion, enabling accurate inversion and reconstruction with the precision of a second-order solver while maintaining the practical efficiency of a first-order Euler method. This solver achieves a 3times runtime speedup compared to state-of-the-art ReFlow inversion and editing techniques, while delivering smaller reconstruction errors and superior editing results in a training-free mode. The code is available at https://github.com/HolmesShuan/FireFlow{this URL}.
Community
Thanks to Gradio for sharing a demo video on X. We have fully open-sourced our code on GitHub and also provided an interactive online demo on HuggingFace Space.
Our findings show that FireFlow delivers 3x faster performance while achieving comparable or even superior results compared to FLUX-based editing methods.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Taming Rectified Flow for Inversion and Editing (2024)
- DiT4Edit: Diffusion Transformer for Image Editing (2024)
- Steering Rectified Flow Models in the Vector Field for Controlled Image Generation (2024)
- Uniform Attention Maps: Boosting Image Fidelity in Reconstruction and Editing (2024)
- SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis (2024)
- Unveil Inversion and Invariance in Flow Transformer for Versatile Image Editing (2024)
- Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editing (2024)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment:
@librarian-bot
recommend
Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper