Support for Lora Weights

#14
by caldwecg - opened

I'm trying to load lora weights onto this playground model and it is not working! Is there something different I need to do? Thanks!

model = "playgroundai/playground-v2-1024px-aesthetic"
vae = AutoencoderKL.from_pretrained('madebyollin/sdxl-vae-fp16-fix', torch_dtype=torch.float16)
lora_scale = 0.9
pipe = DiffusionPipeline.from_pretrained(model, vae=vae, torch_dtype = torch.float16, variant="fp16")
pipe.to("cuda")
pipe.load_lora_weights("/mys3bucket/model/", weight_name = "pytorch_lora_weights.safetensors")

Playground org

Perhaps the VAE isn't compatible, have you tried the VAE that comes with the model?

Which VAE would that be?

Playground org
ehsanakh changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment