Amphion Text-to-Audio (TTA) Recipe
Quick Start
We provide a beginner recipe to demonstrate how to train a cutting edge TTA model. Specifically, it is designed as a latent diffusion model like AudioLDM, Make-an-Audio, and AUDIT.
Supported Model Architectures
Until now, Amphion has supported a latent diffusion based text-to-audio model:
Similar to AUDIT, we implement it in two-stage training:
- Training the VAE which is called
AutoencoderKL
in Amphion. - Training the conditional latent diffusion model which is called
AudioLDM
in Amphion.