|
--- |
|
license: mit |
|
tags: |
|
- motion LoRA |
|
- animatediff |
|
- motion director |
|
- LoRA |
|
--- |
|
## Model Description |
|
This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's [AnimateDiff Motion Director ComfyUI nodes](https://github.com/kijai/ComfyUI-ADMotionDirector). These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's [AnimateDiff-Evolved nodes](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved), however they may be compatible with other AnimateDiff implementations. |
|
|
|
## File summary |
|
|
|
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos | |
|
| ------------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ | |
|
| 16000_cseti_4507345_general-70vid_mv2.safetensors | v2 | (1:1) | 32 | 70 | |
|
|
|
## How to use |
|
- copy the motion lora files into your "ComfyUI\models\animatediff_motion_lora" folder |
|
- Use the "Load Animatediff LoRA" node |
|
- set the context_length parameter to 32 and context_overlap to 8 (it might work with other values but this is how I tested it) |
|
|
|
## Settings and recommendations |
|
- Use it with strength: 0.8 |
|
- This motion LoRA is finetuned on a v2 motion model. It works also with AnimateLCM but don't work with v3 models |
|
- It works with SD 1.5 checkpoints |
|
- Animatediff v3 adapter LoRA is recommended regardless it is a v2 model. |
|
- If you want more motion try increasing the scale multival or lower the strength of the v3 adapter LoRA |
|
- Try playing with the strength of |
|
- motion LoRA |
|
- scale multival |
|
- v3_adapter lora |
|
|
|
like increasing the scale multival and lowering the lora strength. |
|
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point. |
|
|
|
## Examples |
|
|
|
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00112.mp4" title="zoom in 32 frames"></video> |
|
|
|
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00113.mp4" title="zoom in 32 frames"></video> |
|
|
|
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00115.mp4" title="zoom in 32 frames"></video> |
|
|
|
<video controls src="https://huggingface.co/Cseti/General_motionLoRA_32fr_sd15_ad2_v1/resolve/main/LoRA-comparison-us_00116.mp4" title="zoom in 32 frames"></video> |
