diffusion / info.md
adamelliotfields's picture
Rename to `info`
2660d4f verified
|
raw
history blame
2.86 kB
## Usage
Enter a prompt and click **Generate**. [Civitai](https://civitai.com) has an excellent guide on [prompting](https://education.civitai.com/civitais-prompt-crafting-guide-part-1-basics/).
### Compel
Positive and negative prompts are embedded by [Compel](https://github.com/damian0815/compel), enabling weighting and blending. See [syntax features](https://github.com/damian0815/compel/blob/main/doc/syntax.md).
### Arrays
Arrays allow you to generate different images from a single prompt. For example, `a cute [[cat,corgi,koala]]` will expand into 3 prompts. Note that it only works for the positive prompt. You also have to increase `Images` to generate more than 1 image at a time. Inspired by [Fooocus](https://github.com/lllyasviel/Fooocus/pull/1503).
### Autoincrement
If `Autoincrement` is checked, the seed will be incremented for each image. When using arrays, you might want to uncheck this so the same seed is used for each prompt variation.
## Models
All use `float16` (or `bfloat16` if supported). Recommended settings are shown below:
* [fluently/fluently-v4](https://huggingface.co/fluently/Fluently-v4)
- scheduler: DPM++ 2M, guidance: 5-7, steps: 20-30
* [linaqruf/anything-v3-1](https://huggingface.co/linaqruf/anything-v3-1)
- scheduler: DPM++ 2M, guidance: 12, steps: 50, vae: default
* [lykon/dreamshaper-8](https://huggingface.co/Lykon/dreamshaper-8)
- scheduler: DEIS 2M
* [prompthero/openjourney-v4](https://huggingface.co/prompthero/openjourney-v4)
- scheduler: PNDM
* [runwayml/stable-diffusion-v1-5](https://huggingface.co/runwayml/stable-diffusion-v1-5)
- scheduler: PNDM
* [sg161222/realistic_vision_v5.1](https://huggingface.co/SG161222/Realistic_Vision_V5.1_noVAE)
- scheduler: DPM++ 2M, guidance: 4-7
### Schedulers
All are based on [k_diffusion](https://github.com/crowsonkb/k-diffusion) except [DEIS](https://github.com/qsh-zh/deis) and [DPM++](https://github.com/LuChengTHU/dpm-solver). Optionally, the [Karras](https://arxiv.org/abs/2206.00364) noise schedule can be used.
* [DEIS 2M](https://huggingface.co/docs/diffusers/en/api/schedulers/deis)
* [DPM++ 2M](https://huggingface.co/docs/diffusers/en/api/schedulers/multistep_dpm_solver)
* [DPM2 a](https://huggingface.co/docs/diffusers/api/schedulers/dpm_discrete_ancestral)
* [Euler a](https://huggingface.co/docs/diffusers/en/api/schedulers/euler_ancestral)
* [Heun](https://huggingface.co/docs/diffusers/api/schedulers/heun)
* [LMS](https://huggingface.co/docs/diffusers/api/schedulers/lms_discrete)
* [PNDM](https://huggingface.co/docs/diffusers/api/schedulers/pndm)
### VAE
All models use [madebyollin/taesd](https://huggingface.co/madebyollin/taesd) for speed.
## TODO
- [ ] Support LoRA
- [ ] Support embeddings
- [ ] Add VAE radio
- [ ] Add styles
- [ ] Clip skip
- [ ] DeepCache with T-GATE
- [ ] Hires fix
- [ ] Latent preview