TimoBolkart / voca

This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.

Home Page:https://voca.is.tue.mpg.de/en

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

result video flickering problem!

Enin opened this issue · comments

Hello!
Thanks to you're great research.

I have a problem with result video. It successfully generated but video was keep flickering.

videofasfdf.mp4

I used this two scripts which gave in main page and not changed source code.

python run_voca.py --tf_model_fname './model/gstep_52280.model' --ds_fname './ds_graph/output_graph.pb' --audio_fname './audio/test_sentence.wav' --template_fname './template/texture_mesh.obj' --condition_idx 3 --out_path './animation_output'

python run_voca.py --tf_model_fname './model/gstep_52280.model' --ds_fname './ds_graph/output_graph.pb' --audio_fname './audio/test_sentence.wav' --template_fname './template/source3.obj' --condition_idx 3 --uv_template_fname './template/source3.obj' --texture_img_fname './template/source3.png' --out_path './animation_output_textured'

please check this video and tell me how can I fix this problem.

Thank you!

Running the script outputs a set of meshes, one for each frame. If these are correct, then check the renderings for each frame to see if this is a rendering problem, or a problem of the final encoding into a video. I have not seen such kind of flickering before

I checked generated meshes and they were correct i think. maybe it is rendering or encoding problem (pyrender maybe) I will check this part, thank you for answer.


maybe I fixed this problem. I guess too many lights are existed and my gpu couldn't handle rendering and made flickering. I erase some light_pose in the source code and flickering is gone.

thank you!

That is interesting, I wonder why this would cause flickering as the light setup for every frame is identical. But good that you solved it.