TMElyralab / MusePose

MusePose: a Pose-Driven Image-to-Video Framework for Virtual Human Generation

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Is there a way to use full face keypoints too?

G-force78 opened this issue · comments

Hi, great work the consistency across frames is superb, I noticed you developed it partly from moore animate anyone, is there a way to use the face keypoints thay they use?
https://github.com/MooreThreads/Moore-AnimateAnyone/blob/master/configs/inference/pose_videos/anyone-video-4_kps.mp4

Hi, great work the consistency across frames is superb, I noticed you developed it partly from moore animate anyone, is there a way to use the face keypoints thay they use? https://github.com/MooreThreads/Moore-AnimateAnyone/blob/master/configs/inference/pose_videos/anyone-video-4_kps.mp4

Yes, you can set draw_face = True in https://github.com/TMElyralab/MusePose/blob/main/pose/script/dwpose.py#L48
But the result will be wrong because we did not draw the face during training.

Hi, great work the consistency across frames is superb, I noticed you developed it partly from moore animate anyone, is there a way to use the face keypoints thay they use? https://github.com/MooreThreads/Moore-AnimateAnyone/blob/master/configs/inference/pose_videos/anyone-video-4_kps.mp4

Yes, you can set draw_face = True in https://github.com/TMElyralab/MusePose/blob/main/pose/script/dwpose.py#L48 But the result will be wrong because we did not draw the face during training.

TZYSJTU

  1. yes,I test with face,Get blurry faces

https://github.com/TMElyralab/MusePose/assets/48466610/948ba738-1931-4220-9ffe-343efe248a2f
2. I want to know how to remove the blue dot on finger
image

Hi, great work the consistency across frames is superb, I noticed you developed it partly from moore animate anyone, is there a way to use the face keypoints thay they use? https://github.com/MooreThreads/Moore-AnimateAnyone/blob/master/configs/inference/pose_videos/anyone-video-4_kps.mp4

Yes, you can set draw_face = True in https://github.com/TMElyralab/MusePose/blob/main/pose/script/dwpose.py#L48 But the result will be wrong because we did not draw the face during training.

TZYSJTU

  1. yes,I test with face,Get blurry faces

https://github.com/TMElyralab/MusePose/assets/48466610/948ba738-1931-4220-9ffe-343efe248a2f 2. I want to know how to remove the blue dot on finger image

rgb <-> bgr.
Just change the channel order of the img.

Hi, great work the consistency across frames is superb, I noticed you developed it partly from moore animate anyone, is there a way to use the face keypoints thay they use? https://github.com/MooreThreads/Moore-AnimateAnyone/blob/master/configs/inference/pose_videos/anyone-video-4_kps.mp4

Yes, you can set draw_face = True in https://github.com/TMElyralab/MusePose/blob/main/pose/script/dwpose.py#L48 But the result will be wrong because we did not draw the face during training.

TZYSJTU

  1. yes,I test with face,Get blurry faces

https://github.com/TMElyralab/MusePose/assets/48466610/948ba738-1931-4220-9ffe-343efe248a2f 2. I want to know how to remove the blue dot on finger image

rgb <-> bgr. Just change the channel order of the img.

OK , about pose align video (About whether RGB or BGR format affects video generation?),For hand generation, rgb effect is not as good as bgr effect, is that true, or is it caused by my different alignment pose

Hi, great work the consistency across frames is superb, I noticed you developed it partly from moore animate anyone, is there a way to use the face keypoints thay they use? https://github.com/MooreThreads/Moore-AnimateAnyone/blob/master/configs/inference/pose_videos/anyone-video-4_kps.mp4

Yes, you can set draw_face = True in https://github.com/TMElyralab/MusePose/blob/main/pose/script/dwpose.py#L48 But the result will be wrong because we did not draw the face during training.

TZYSJTU

  1. yes,I test with face,Get blurry faces

https://github.com/TMElyralab/MusePose/assets/48466610/948ba738-1931-4220-9ffe-343efe248a2f 2. I want to know how to remove the blue dot on finger image

rgb <-> bgr. Just change the channel order of the img.

OK , about pose align video (About whether RGB or BGR format affects video generation?),For hand generation, rgb effect is not as good as bgr effect, is that true, or is it caused by my different alignment pose

During training, we use the red finger. So keeping it same when testing should be better.