Deflate / README.md
Remade's picture
Update README.md
22a6cce verified
metadata
license: other
language:
  - en
base_model:
  - Wan-AI/Wan2.1-I2V-14B-480P
  - Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
pipeline_tag: image-to-video
tags:
  - text-to-image
  - lora
  - diffusers
  - template:diffusion-lora
  - image-to-video
widget:
  - text: >-
      The video opens with a man. As the video progresses, the man begins to
      d3d1at3 deflate it, gradually shrinking and losing shape, eventually
      flattening completely into a lifeless, deflated mass on the ground. 
    output:
      url: example_videos/man_deflate.mp4
  - text: >-
      The video opens with a lamp. As the video progresses, the lamp begins to
      d3d1at3 deflate it, gradually shrinking and losing shape, eventually
      flattening completely into a lifeless, deflated mass on the ground.
    output:
      url: example_videos/lamp_deflate.mp4
  - text: >-
      The video opens with a balloon. As the video progresses, the balloon
      begins to d3d1at3 deflate it, gradually shrinking and losing shape,
      eventually flattening completely into a lifeless, deflated mass on the
      ground.
    output:
      url: example_videos/balloon_deflate.mp4
  - text: >-
      The video opens with a cat. As the video progresses, the cat begins to
      d3d1at3 deflate it, gradually shrinking and losing shape, eventually
      flattening completely into a lifeless, deflated mass on the ground.
    output:
      url: example_videos/cat_deflate.mp4

Deflate Effect LoRA for Wan2.1 14B I2V 480p

Overview

This LoRA is trained on the Wan2.1 14B I2V 480p model and allows you to deflate any object in an image. The effect works on a wide variety of objects, from animals to vehicles to people!

Features

  • Transform any image into a video of it being deflated
  • Trained on the Wan2.1 14B 480p I2V base model
  • Consistent results across different object types
  • Simple prompt structure that's easy to adapt

Community

  • Discord: Join our community to generate videos with this LoRA for free
  • Request LoRAs: We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!
Prompt
The video opens with a man. As the video progresses, the man begins to d3d1at3 deflate it, gradually shrinking and losing shape, eventually flattening completely into a lifeless, deflated mass on the ground.
Prompt
The video opens with a lamp. As the video progresses, the lamp begins to d3d1at3 deflate it, gradually shrinking and losing shape, eventually flattening completely into a lifeless, deflated mass on the ground.
Prompt
The video opens with a balloon. As the video progresses, the balloon begins to d3d1at3 deflate it, gradually shrinking and losing shape, eventually flattening completely into a lifeless, deflated mass on the ground.
Prompt
The video opens with a cat. As the video progresses, the cat begins to d3d1at3 deflate it, gradually shrinking and losing shape, eventually flattening completely into a lifeless, deflated mass on the ground.

Model File and Inference Workflow

📥 Download Links:


Recommended Settings

  • LoRA Strength: 1.0
  • Embedded Guidance Scale: 6.0
  • Flow Shift: 5.0

Trigger Words

The key trigger phrase is: d3d1at3 deflate it

Prompt Template

For best results, use this prompt structure:

The video opens with a [object]. As the video progresses, the [object] begins to d3d1at3 deflate it, gradually shrinking and losing shape, eventually flattening completely into a lifeless, deflated mass on the ground.

Simply replace [object] with whatever you want to see deflated!

ComfyUI Workflow

This LoRA works with a modified version of Kijai's Wan Video Wrapper workflow. The main modification is adding a Wan LoRA node connected to the base model.

See the Downloads section above for the modified workflow.

Model Information

The model weights are available in Safetensors format. See the Downloads section above.

Training Details

  • Base Model: Wan2.1 14B I2V 480p
  • Training Data: Trained on 1.5 minutes of video comprised of 20 short clips (each clip captioned separately) of things being deflated
  • Epochs: 20

Additional Information

Training was done using Diffusion Pipe for Training

Acknowledgments

Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!