anhnct

/

audioldm2_gigaspeech

like 11

Description:
I encountered a 'TypeError' while running the code snippet below. It seems like the 'transcript' argument is not recognized, although it's listed as a valid argument in the documentation. Can someone please help me understand why this error is occurring and how to resolve it?

import scipy
import torch
from diffusers import AudioLDM2Pipeline

repo_id = "anhnct/audioldm2_gigaspeech"
pipe = AudioLDM2Pipeline.from_pretrained(repo_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")

# define the prompts
prompt = "An female actor say with angry voice"
transcript= "hi, i am yeong min. nice to meet you"
negative_prompt = "low quality"

# set the seed for generator
generator = torch.Generator("cuda").manual_seed(1)

# run the generation
audio = pipe(
    prompt,
    negative_prompt=negative_prompt,
    transcription=transcript,
    num_inference_steps=200,
    audio_length_in_s=8.0,
    num_waveforms_per_prompt=1,
    generator=generator,
    max_new_tokens=512
).audios

# save the best audio sample (index 0) as a .wav file
scipy.io.wavfile.write("introduce.wav", rate=16000, data=audio[0])

Error Message:

TypeError: __call__() got an unexpected keyword argument 'transcription'

Environment:

• Python version: 3.9
• Operating system: Linux
• Hardware acceleration (if relevant): CUDA version 12.2