oms_sdxl_lcm / README.md
h1t's picture
Update README.md
fc55902
|
raw
history blame
No virus
1.76 kB
metadata
license: openrail++
title: 'OMS Space for SDXL '
sdk: gradio
emoji: πŸ‘€
colorFrom: indigo
colorTo: yellow
pinned: true

One More Step: A Versatile Plug-and-Play Module for Rectifying Diffusion Schedule Flaws and Enhancing Low-Frequency Controls

One More Step (OMS) module was proposed in One More Step: A Versatile Plug-and-Play Module for Rectifying Diffusion Schedule Flaws and Enhancing Low-Frequency Controls by Minghui Hu, Jianbin Zheng, Chuanxia Zheng, Tat-Jen Cham et al.

By incorporating one minor, additional step atop the existing sampling process, it can address inherent limitations in the diffusion schedule of current diffusion models. Crucially, this augmentation does not necessitate alterations to the original parameters of the model. Furthermore, the OMS module enhances control over low-frequency elements, such as color, within the generated images.

Our model is versatile and allowing for seamless integration with a broad spectrum of prevalent Stable Diffusion frameworks. It demonstrates compatibility with community-favored tools and techniques, including LoRA, ControlNet, Adapter, and other foundational models, underscoring its utility and adaptability in diverse applications.

Usage

OMS now is supported diffusers with a customized pipeline, as detailed in github. To run the model, first install the latest version of diffusers (especially for LCM feature) as well as accelerate and transformers.

pip install --upgrade pip
pip install --upgrade diffusers transformers accelerate

And then we clone the repo

git clone https://github.com/mhh0318/OneMoreStep.git
cd OneMoreStep