This is the official repository for MotionDirector weights. Code and details are at: https://github.com/showlab/MotionDirector.git
Clone the repo as follows:
git lfs clone --depth 1 --single-branch --branch main https://huggingface.co/ruizhaocv/MotionDirector_weights.git ./outputs
After installing dependencies, run the following command to generate a.mp4 video:
#!/bin/bash
eval "$(conda shell.bash hook)"
conda activate motiondirector
MODEL_PATH=./models/zeroscope_v2_576w
PROMPT="A lion is running past the pyramids."
python MotionDirector_inference.py \
--model $MODEL_PATH \
--prompt "$PROMPT" \
--checkpoint_folder ./outputs/train/car_16/ \
--checkpoint_index 150 \
--noise_prior 0.5 \
--seed 431554 | tee ./local_log.log
The generated .mp4 is then stored under the inference directory.