patrickvonplaten's picture
Add diffusers code example
7daf804
|
raw
history blame
1.61 kB
metadata
license: creativeml-openrail-m

Spider-Verse Diffusion

This is the fine-tuned Stable Diffusion model trained on movie stills from Sony's Into the Spider-Verse. Use the tokens spiderverse style in your prompts for the effect.

If you enjoy this model, please check out my other models on Huggingface

🧨 Diffusers

This model can be used just like any other Stable Diffusion model. For more information, please have a look at the Stable Diffusion.

You can also export the model to ONNX, MPS and/or FLAX/JAX.

#!pip install diffusers transformers scipy torch
from diffusers import StableDiffusionPipeline
import torch

model_id = "nitrosocke/spider-verse-diffusion"
pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16)
pipe = pipe.to("cuda")

prompt = "a magical princess with golden hair, spiderverse style"
image = pipe(prompt).images[0]

image.save("./magical_princess.png")

Portraits rendered with the model: Portrait Samples Sample images used for training: Training Samples

This model was trained using the diffusers based dreambooth training and prior-preservation loss in 3.000 steps.