apple / ml-neuman

Official repository of NeuMan: Neural Human Radiance Field from a Single Video (ECCV 2022)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Missing output files when preprocessing on my own data

TiantianWang opened this issue · comments

Hi,

When I run the gen_run.py to preprocess my own data. For the step 10, errors are shown below when running optimize_smpl.py file.

###########
can not find keypoints for 00000.png
can not find densepose for 00000.png
can not find keypoints for 00001.png
can not find densepose for 00001.png
can not find keypoints for 00002.png
can not find densepose for 00002.png
......
############

It seems that the Step 5 DensePose and Step 6 2D keypoints did not generate the required .npy file. May I know how to obtain both files for Step 5 and Step 6?

Thanks!

Hmmmmm, is there any error messages when running pose estimation(mmpose/detectron2)?

Hmmmmm, is there any error messages when running pose estimation(mmpose/detectron2)?

This part can be run successfully. The output is ./densepose/output.pkl without single frame .npy output.

I don't recall I save the output.pkl file...
Do you use the customized repo?

RUN cd /neuman/preprocess && \
git clone --recurse-submodules https://github.com/jiangwei221/detectron2.git && \
cd detectron2 && \
git checkout 2048058b6790869e5add8832db2c90c556c24a3e
RUN cd /neuman/preprocess && \
git clone --recurse-submodules https://github.com/jiangwei221/mmpose.git && \
cd mmpose && \
git checkout 8b788f93200ce6485e885da0c736f114e4de8eaf

are there any visualizations saved?

I don't recall I save the output.pkl file... Do you use the customized repo?

RUN cd /neuman/preprocess && \
git clone --recurse-submodules https://github.com/jiangwei221/detectron2.git && \
cd detectron2 && \
git checkout 2048058b6790869e5add8832db2c90c556c24a3e
RUN cd /neuman/preprocess && \
git clone --recurse-submodules https://github.com/jiangwei221/mmpose.git && \
cd mmpose && \
git checkout 8b788f93200ce6485e885da0c736f114e4de8eaf

are there any visualizations saved?

I have checked the 2 repos and found that I used the wrong ones. After installing the repos you mentioned above, the .npy files can be generated.

Thanks a lot for the help!