alanhzh / comfyui-animatediff

AnimateDiff for ComfyUI

AnimateDiff for ComfyUI

AnimateDiff integration for ComfyUI, adapts from sd-webui-animatediff. Please read the original repo README for more information.

How to Use

1. Clone this repo into custom_nodes folder.
2. Download motion modules from Google Drive | HuggingFace | CivitAI | Baidu NetDisk. You only need to download one of mm_sd_v14.ckpt | mm_sd_v15.ckpt. Put the model weights under comfyui-animatediff/models/. DO NOT change model filename.

Samples

txt2img

img2img

Known Issues

GIF split into multiple scenes

This is usually due to memory (VRAM) is not enough to process the whole image batch at the same time. Try reduce the image size and frame number.

GIF has Wartermark after update to the latest version

See continue-revolution/sd-webui-animatediff#31

As mentioned in the issue thread, it seems to be due to the training dataset. The new version is the correct implementation and produces smoother GIFs compared to the older version.

Old revision	New revision

I played around with both version and found that the watermark only present in some models, not always. So I've brought back the old method and also created a new node with the new method. You can try both to find the best fit for each model.