apple / ml-neuman

Official repository of NeuMan: Neural Human Radiance Field from a Single Video (ECCV 2022)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Problem occured preprocessing my own video __ SMPL parameters8/10

KevinzhouCUC opened this issue · comments

The detail is in the picture down below.

624804f27906884237e2edc9d70c6f6

I've been following the bash file ./run.sh
The problem occurs when using the tuned model ROMP_HRNet32_V1.pkl

Processed 0 / 23 images
Then it terminates. I really have no idea what to do. Could you please help me out of the situation?

In our release, we used a specific version of ROMP(f1aaf0c1d90435bbeabe39cf04b15e12906c6111) + specific weights, as hardcoded in the Docker file and bash file.
If you want to use the latest ROMP, you probably need to make sure the latest ROMP export the same data format as ours.

I've retried with the ROMP version and strictly followed the docker file and bash file, but still the same. Is 'missing parameters' a normal phenomenon or it's a problem about loading the model pkl?
I don't think this step exported anything useful cuz step 9&10 has AssertionError.
Or maybe the video I use didn't meet the requirements...

What is your GPU model?

The batch size is 32, your 23 images should be done in one inference. Maybe check the output folder?

I changed the video file and the problem solved. Weird problems occur if the video failed to meet requirements. In my situation, camera didn't make a obvious move with human.