Diffusers

You are viewing v0.29.0 version. A newer version v0.31.0 is available.

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Normalization layers

Customized normalization layers for supporting various models in 🤗 Diffusers.

( embedding_dim: int num_embeddings: int )

Parameters

Norm layer modified to incorporate timestep embeddings.

( embedding_dim: int num_embeddings: Optional = None )

Parameters

Norm layer adaptive layer norm zero (adaLN-Zero).

( embedding_dim: int use_additional_conditions: bool = False )

Parameters

embedding_dim (int) — The size of each embedding vector.
use_additional_conditions (bool) — To use additional conditions for normalization or not.

Norm layer adaptive layer norm single (adaLN-single).

As proposed in PixArt-Alpha (see: https://arxiv.org/abs/2310.00426; Section 2.3).

( embedding_dim: int out_dim: int num_groups: int act_fn: Optional = None eps: float = 1e-05 )

Parameters

embedding_dim (int) — The size of each embedding vector.
num_embeddings (int) — The size of the embeddings dictionary.
num_groups (int) — The number of groups to separate the channels into.
act_fn (str, optional, defaults to None) — The activation function to use.
eps (float, optional, defaults to 1e-5) — The epsilon value to use for numerical stability.

GroupNorm layer modified to incorporate timestep embeddings.