HumanAIGC / AnimateAnyone

Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Driving pose skeleton to approximate the length of the character’s skeleton in the reference image

learnuser1 opened this issue · comments

During inference, we rescale the length of the driving pose skeleton to approximate the length of the character’s
skeleton in the reference image. Does anyone know how to do this step?

We tried rescaling through the external rectangle of the kps common to ref and motion, and tested in Moore-AnimateAnyone, but the effect was not significantly improved.

We tried rescaling through the external rectangle of the kps common to ref and motion, and tested in Moore-AnimateAnyone, but the effect was not significantly improved.

I tried scaling the skeleton and it worked, but it wasn't good enough.

In my work, skeleton alignment was effective for quality (Ref : woman, Pose : man)

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

It's so greatly, i have some doubts, how to select the key points?

In my work, skeleton alignment was effective for quality (Ref : woman, Pose : man)

How did you achieve it? Can you share the code.

I tried to extract several key points from the dwpose and perform affine transformation to obtain a matrix. Then, I processed each frame of the pose video and achieved better results

That's so great. Really want to know how to make it! Can you share the code?