rese1f / StableVideo

[ICCV 2023] StableVideo: Text-driven Consistency-aware Diffusion Video Editing

Home Page:https://rese1f.github.io/StableVideo/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

The background is always black

qxzha opened this issue · comments

@rese1f , Thanks for your nice work!
But I met a hating problem.
I have trained my own video using the method of NLA, but when I made video style transfer using this work, the background of foreground is always black, which results in the render video's background is also
black.
What could I do to get a surprising performance like your given demo video?

The bad vidoes are blow:

image

It seems not a bug but causing by the poor performance by Atlas, is the camera moving very fast?

yea, that’s our limitation, u can try some video with less camera motion or cut the video into shorter clips to avoid this kind of failure case