|
---
|
|
license: mit
|
|
tags:
|
|
- stable diffusion
|
|
- animatediff
|
|
- motion lora
|
|
language:
|
|
- en
|
|
---
|
|
- [Basic camera motion LoRAs for Animatediff v2 motion models - version 1](#basic-camera-motion-loras-for-animatediff-v2-motion-models---version-1)
|
|
- [Model Description](#model-description)
|
|
- [File summary](#file-summary)
|
|
- [How to use](#how-to-use)
|
|
- [General recommendation](#general-recommendation)
|
|
- [Details and examples](#details-and-examples)
|
|
- [Zooming in](#zooming-in)
|
|
- [Zooming out](#zooming-out)
|
|
- [Lateral (horizontal) left](#lateral-horizontal-left)
|
|
- [Lateral (horizontal) rigth](#lateral-horizontal-rigth)
|
|
|
|
# Basic camera motion LoRAs for Animatediff v2 motion models - version 1
|
|
|
|
## Model Description
|
|
This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's [AnimateDiff Motion Director ComfyUI nodes](https://github.com/kijai/ComfyUI-ADMotionDirector). These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's [AnimateDiff-Evolved nodes](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved), however they may be compatible with other AnimateDiff implementations.
|
|
|
|
## File summary
|
|
|
|
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
|
|
| ------------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
|
|
| 1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
|
| 1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
|
| 2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors | v2 | (3:2) | 32 | 10 |
|
|
| 1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
|
| 1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
|
| 1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
|
| 1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
|
|
|
## How to use
|
|
- copy the motion lora files into your "ComfyUI\models\animatediff_motion_lora" folder
|
|
- Use the "Load Animatediff LoRA" node
|
|
|
|
## General recommendation
|
|
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
|
|
- They work with SD 1.5 checkpoints
|
|
- Animatediff v3 adapter LoRA is recommended regardless they are v2 models
|
|
- If you want more motion try increasing the scale multival
|
|
- I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
|
|
- Try playing with the strength of
|
|
- motion LoRA
|
|
- scale multival
|
|
- v3_adapter lora
|
|
|
|
like increasing the scale multival and lowering the lora strength.
|
|
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
|
|
|
|
## Details and examples
|
|
|
|
### Zooming in
|
|
- recommended strength: 0.8-1.0
|
|
|
|
<video controls src="asset\LoRA-comparison-zoomin16.mp4" title="back view"></video>
|
|
|
|
### Zooming out
|
|
- recommended strength: 0.8-1.0
|
|
|
|
<video controls src="asset\LoRA-comparison-zoomout16.mp4" title="zoom out"></video>
|
|
|
|
### Lateral (horizontal) left
|
|
- recommended strength: 0.8-1.0
|
|
|
|
<video controls src="asset\LoRA-comparison-lateral_left.mp4" title="right view"></video>
|
|
|
|
### Lateral (horizontal) rigth
|
|
- recommended strength: 0.8-1.0
|
|
|
|
<video controls src="asset\LoRA-comparison-lateral_right.mp4" title="right view"></video> |
