Commit
•
81e7f9e
1
Parent(s):
318f5a3
Update README.md
Browse files
README.md
CHANGED
@@ -17,15 +17,19 @@ is a text-to-audio _latent diffusion model (LDM)_ that learns continuous audio r
|
|
17 |
latents. AudioLDM takes a text prompt as input and predicts the corresponding audio. It can generate text-conditional
|
18 |
sound effects, human speech and music.
|
19 |
|
20 |
-
|
21 |
|
22 |
-
**
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
|
24 |
-
| Checkpoint | Training Data (h) | Training Steps | Params | Frechet Distance ↓ |
|
25 |
-
|-----------------|-------------------|----------------|--------|-------------------------------|
|
26 |
-
| AudioLDM-S | 137 | 0.6M | 181M | 29.48 |
|
27 |
-
| AudioLDM-L | 137 | 0.6M | 739M | 27.12 |
|
28 |
-
| AudioLDM-L-Full | 9174 | 1.5M | 739M | **23.31** |
|
29 |
|
30 |
## Model Sources
|
31 |
|
|
|
17 |
latents. AudioLDM takes a text prompt as input and predicts the corresponding audio. It can generate text-conditional
|
18 |
sound effects, human speech and music.
|
19 |
|
20 |
+
# Checkpoint Details
|
21 |
|
22 |
+
This is the **large** version of the AudioLDM model, with twice the number of UNet channels and head channels as the small checkpoints. The four AudioLDM checkpoints are summarised in the table below:
|
23 |
+
|
24 |
+
**Table 1:** Summary of the AudioLDM checkpoints.
|
25 |
+
|
26 |
+
| Checkpoint | Training Data (h) | Training Steps | Params |
|
27 |
+
|-----------------------------------------------------------------------|-------------------|----------------|--------|
|
28 |
+
| [audioldm-s-full](https://huggingface.co/cvssp/audioldm) | 9174 | 1.5M | 421M |
|
29 |
+
| [audioldm-s-full-v2](https://huggingface.co/cvssp/audioldm-s-full-v2) | 9174 | > 1.5M | 421M |
|
30 |
+
| [audioldm-m-full](https://huggingface.co/cvssp/audioldm-m-full) | 9174 | 1.5M | 652M |
|
31 |
+
| [audioldm-l-full](https://huggingface.co/cvssp/audioldm-l-full) | 9174 | 1.5M | 975M |
|
32 |
|
|
|
|
|
|
|
|
|
|
|
33 |
|
34 |
## Model Sources
|
35 |
|