FLUX.1-Merges / README.md
HaileyStorm's picture
Update README.md
3c9d7a8 verified
|
raw
history blame
No virus
1.85 kB
---
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
language:
- en
library_name: diffusers
pipeline_tag: text-to-image
---
# FLUX.1 Merged Models - Several different Schnell:Dev ratios
This repository includes merged models from black-forest-labs/FLUX.1-dev and black-forest-labs/FLUX.1-schnell, in different ratios. The licenses of both models apply to these merged models.
Inspired by: https://huggingface.co/sayakpaul/FLUX.1-merged
## Motivation
The goal is to create modeld which balance generation speed - allowing near-Dev generations in more like 4-16 generations.
## Results
<img src="./images/astronaut_grid_688x512.png">
<img src="./images/hacker_grid_688x512.png">
<img src="./images/astronaut_grid_880x656.png">
<img src="./images/sign_grid_880x656.png">
<img src="./images/astronaut_grid_880x656_saved_models.png">
<img src="./images/sign_grid_880x656_saved_models.png">
Based on these results, I saved and uploaded models for the ratios 10:1, 4:1, and 2.5:1.
I recommend The following number of generation steps for these models:
| Model | Steps |
|-------|-------|
| 10:1 | 4-8 |
| 4:1 | 8-16 |
| 2.5:1 | 8-16+ |
## Procedure
I modified sayakpaul's merge code to do merges at various ratios (weights), rather than simply averaging the two 1:1, and generated a series of images with those models, and the originals. See [merge_compare.py](./merege_compare.py).
I first did a series of ratios ranging from mostly Schnell to mostly Dev. Based on those results, I did more tests with larger images in ratios favoring Schnell more.
From these tests, I saved and uploaded a few of my favorite ratios, namely 10:1, 4:1, and 2.5:1. Then I did some additional generations using those models, see [infer.py](./infer.py).