Motion-Zero

Code for paper: Motion-Zero: Zero-Shot Moving Object Control Framework for Diffusion-Based Video Generation (AAAI 2025) (Arxiv) (Website).

Env Installation

Create a conda environment and install required modules.

conda env create -n mz python=3.8
conda activate mz
pip install -r requirements.txt

Inference

python moving_test.py --model zeroscope_v2_576w --checkpoint_folder ./outputs/train/riding_bicycle --checkpoint_index 300 --noise_prior 0. --seed 7192280 \
--sdp \
--prompt "A cat is running on the grass." \
--token_indices 2 --bbox [[0,208,192,376]] \
--attnres 12 \
--repeat_num 3 \
--boxdiff 1 \
--moving \
--temp \
--attnloss 0.1 \
--posloss 0.05

Bibtex

@inproceedings{chen2025motion,
  title={Motion-Zero: A Zero-Shot Trajectory Control Framework of Moving Object for Diffusion-Based Video Generation},
  author={Chen, Changgu and Shu, Junwei and He, Gaoqi and Wang, Changbo and Li, Yang},
  booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
  volume={39},
  number={2},
  pages={2016--2024},
  year={2025}
}