TimoBolkart / voca

This codebase demonstrates how to synthesize realistic 3D character animations given an arbitrary speech signal and a static character mesh.

Home Page:https://voca.is.tue.mpg.de/en

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Initialization Of Decoder Layer

Parikshat1998 opened this issue · comments

In the paper, you mentioned that you are initializing the last layer of the decoder using the PCAs of Vertex displacements in the training data. So, these vertex displacements are computed due to expression changes in the training meshes or they are generic and capture the overall vertex displacements of the meshes?

The name of the file init_expression_basis.npy, so why it is named as expression basis, and also if I explore the shape of the tensor it is (5023*3,100). Can you please provide more idea on this initialization technique?