jsnln / fite

eccv 2022

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Could you please provide a sample pose sequence

Zhangjzh opened this issue · comments

I was trying to follow insturctions bellow.

To animate a certain subject, say rp_carla_posed_004, prepare a pose sequence (.npz files containing the pose and transl parameters) under the directory data_scans/rp_carla_posed_004/test/

I don't know what the pose sequence(.npz files) should be like. Could you please provide a sample pose sequence?
Thanks very much!

commented

Hi. The detailed description of what these .npz files should be can be found in Data Preparation for Training under the section The Whole Pipeline in the README. Note that for inference only two keys (pose and transl) are needed.

You can also use the pose sequences in CAPE, whose format is consistent with ours (for inference, not training). However, we cannot directly provide them due to copyright restrictions.

Thanks you for your prompt reply!

Besides, I generate the T-pose SMPL mesh by setting pose and shape parameters to zero. Is this correct?

commented

Besides, I generate the T-pose SMPL mesh by setting pose and shape parameters to zero. Is this correct?

Yes, the T-pose SMPL should have zero pose parameters. But I am not sure about using zero shape parameters. Shape parameters should be selected to match your training data. Normally this can be obtained by keypoints-based SMPL fitting methods.

In our work, we have used the ground truth SMPLX meshes provided in ReSynth, and applied the SMPLX-to-SMPL transfer model here to obtain shape and pose parameters.