FLUX.1-Merges / README.md
HaileyStorm's picture
Update README.md
e252092 verified
|
raw
history blame
2.35 kB
metadata
license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
language:
  - en
library_name: diffusers
pipeline_tag: text-to-image

FLUX.1 Merged Models - Several different Schnell:Dev ratios

This repository includes merged models from black-forest-labs/FLUX.1-dev and black-forest-labs/FLUX.1-schnell, in different ratios. The licenses of both models apply to these merged models.

Inspired by: https://huggingface.co/sayakpaul/FLUX.1-merged

Motivation

The goal is to create modeld which balance generation speed - allowing near-Dev generations in more like 4-16 generations.

Results

Based on these results, I saved and uploaded models for the ratios 10:1, 4:1, and 2.5:1.

I recommend The following number of generation steps for these models:

Model Steps
10:1 4-8
4:1 8-16
2.5:1 8-16+

Procedure

I modified sayakpaul's merge code to do merges at various ratios (weights), rather than simply averaging the two 1:1, and generated a series of images with those models, and the originals. See merge_compare.py.

I first did a series of ratios ranging from mostly Schnell to mostly Dev. Based on those results, I did more tests with larger images in ratios favoring Schnell more.

From these tests, I saved and uploaded a few of my favorite ratios, namely 10:1, 4:1, and 2.5:1. Then I did some additional generations* using those models, see infer.py.

*1280x1024, Prompt1: "Impressionistic tableau medium shot painting with soft, blended brushstrokes and muted colors complemented by sporadic vibrant highlights.", Prompt2: 10:1, 6 steps:

4:1, 10 steps:

2.51:1, 16 steps:

All image genereations where done with CFG=3.5. The test/grid images were done with seed=0, and the images of the two women with seed=42 (best of a batch of 4).