thecooltechguy / ComfyUI-MagicAnimate

Easily use MagicAnimate within ComfyUI

ComfyUI-MagicAnimate

Easily use Magic Animate within ComfyUI!

• Installation
• Node types
• Example workflows
  • Animate any person's image with a DeepPose video input

Need help? Join our Discord!

Installation (this custom node will auto-download ~15GB of model weights!)

Option 1: Automatic installation (Recommended)

Please install "ComfyUI-MagicAnimate" via the ComfyUI-Manager.

Option 2: Manual installation

cd ComfyUI/custom_nodes/
git clone https://github.com/thecooltechguy/ComfyUI-MagicAnimate
cd ComfyUI-MagicAnimate/
python -m pip install -r requirements.txt

Node types

• MagicAnimateModelLoader
  • Loads the MagicAnimate model
• MagicAnimate
  • Uses the MagicAnimate model to animate an input image using an input DeepPose video, and outputs the generated video

Example workflows

Animate any person's image with a DeepPose video input

https://comfyworkflows.com/workflows/2e137168-91f7-414d-b3c6-23feaf704fdb

TODO

• Fix white color in output (credits: @mingqizhang)
• Optimize amount of models downloaded (now requires 15GB and only downloads the models needed)
• Refactor to use any Model, VAE, and ControlNet input from ComfyUI (this should also further reduce number of models downloaded)