The demo 3D looks ok but not match with the predicted depth image

[Negar]

Hi,

I am trying to use the predicted depth image to generate the 3D point cloud of an indoor scene.

When I generate the depth image based on what you have in the demo or Colab and compute the 3D, this is what I get:

But when I use the demo to get the 3D, I get the following point cloud:

I was wondering what could be the possible reason for this weird result, or could you provide the code that generates the 3D from the estimated depth (based on demo)?

[Bingxin Ke]

Hi, the predicted depth is up to unknown scale and shift. To get the desired 3D point cloud, you might need to use other methods to estimate these two factors, e.g. aligning to some in-distribution metric depth methods, or eyeballing.