19reborn / NeuS2

[ICCV 2023] Official code for NeuS2

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

bad result with neuspp without mask

maorp opened this issue · comments

Hi, first thank you for this amazing work. I have a custom dataset and im trying using neuspp. i sometimes get bad result when the captured person is not in the middle of the images. this dataset is from a setup with 35 static calibrated cams. I can supply the data for debug if needed. i get good result when the person stands close to the center.
here is gui screenshot - seems like the bg nerf didnt reach a good state so the sdf tried to fill the cube:
image

here is a result with same cameras but when the person close to center:
image

since the person is almost outside of aabb i also tried enlarging to "aabb_scale": 2 - but it seems neuspp does not handle it and i get zero samples per ray with it...

Hi, i think i have read somewhere that for NeuSPP, scale must be =1, i.e. the scene must take place inside the cube at any time. Maybe you should try to rescale.

@maorp Hi, thanks for using our codes. Just as @albb20 suggested, you can tune scale smaller while fixing aabb_scale to 1.

Thanks. Ill retry a smaller scale factor.

hi again, tried scale: 0.25, but still bad results. it starts optimizing and then stops with loss: Nan.
i can send the data if needed...
image

hi@maorp, I wonder how to apply GUI in NeuS2 Project?