patrikhuber / 4dface

Real-time 3D face tracking and reconstruction from 2D video

Home Page:https://www.4dface.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Moving the face in rendering window

Adra8373 opened this issue · comments

Hi

I hope you are doing well.

I have a question about that why the face is moving when the speaker starts to talk, I mean the rendered face is moving not just the lips. Could you answer me, please?

Regards

Hi,
I'm not sure what you mean. The head is rotating, yes. But the translation is set to zero.
Please clarify and I'm happy to re-open if there is an issue here.

Hi

Thanks for replying. What I meant is that the rendered mesh is moving not just the lips (all the head is moving according to the lips movements. ), I mean it is not as the speaker do when start talking, in usual the head is static, but the lips is moving.

Regards

Ok, I think I maybe see what you mean now. You could use draw_wireframe(...) on the original image to verify the fitting results.

I think what you want is maybe better blendshapes, that don't just model expressions, but lip movements.

Thanks. I used draw_wireframe(...), but I still have the same problem.

draw_wireframe(...) is only for inspecting, obviously. As mentioned above you may want to use some blendshapes that model lip movements.

My model contains different lip shapes already, so I do not need to add them separately.

Ok, cool! Well, then I guess you need to find out why it happens? ;-)