usage.md · adamelliotfields/diffusion at 23f4f95e106cca27abb37705325a710b6e55f62a

Usage

Enter a prompt and click Generate.

Prompting

Positive and negative prompts are embedded by Compel for weighting. You can use a float or +/-. For example:

man, portrait, blue+ eyes, close-up
man, portrait, (blue)1.1 eyes, close-up
man, portrait, (blue eyes)-, close-up
man, portrait, (blue eyes)0.9, close-up

Note that ++ is 1.1^2 (and so on). See syntax features to learn more and read Civitai's guide on prompting for best practices.

Arrays

Arrays allow you to generate different images from a single prompt. For example, [[cat,corgi]] will expand into 2 separate prompts. Make sure Images is set accordingly (e.g., 2). Only works for the positive prompt. Inspired by Fooocus.

Embeddings

Select multiple negative textual inversion embeddings. Fast Negative and Bad Dream can be used standalone or together; Unrealistic Dream should be combined with one of the others:

<fast_negative>: all-purpose (default)
<bad_dream>: DreamShaper-style
<unrealistic_dream>: realistic add-on

Styles

Styles are prompt templates from twri's sdxl_prompt_styler Comfy node. Start with a subject like "cat", pick a style, and iterate from there.

Scale

Rescale up to 4x using Real-ESRGAN.

Models

Each model checkpoint has a different aesthetic:

lykon/dreamshaper-8: general purpose (default)
fluently/fluently-v4: general purpose merge
linaqruf/anything-v3-1: anime
prompthero/openjourney-v4: Midjourney-like
runwayml/stable-diffusion-v1-5: base
sg161222/realistic_vision_v5.1: photorealistic

Schedulers

Optionally, the Karras noise schedule can be used:

Advanced

DeepCache

DeepCache (Ma et al. 2023) caches lower U-Net layers and reuses them every Interval steps:

1: no caching
2: more quality (default)
3: balanced
4: more speed

ToMe

Token merging (Bolya & Hoffman 2023) reduces the number of tokens processed by the model. Set Ratio to the desired reduction factor. ToMe's impact is more noticeable on larger images.

FreeU

FreeU (Si et al. 2023) re-weights the contributions sourced from the U-Net’s skip connections and backbone feature maps to potentially improve image quality.

Clip Skip

When enabled, the last CLIP layer is skipped. This can improve image quality with anime models.

Tiny VAE

Enable madebyollin/taesd for almost instant latent decoding with a minor loss in detail. Useful for development.

Prompt Truncation

When enabled, prompts will be truncated to CLIP's limit of 77 tokens. By default this is disabled, so Compel will chunk prompts into segments rather than cutting them off.