mrharicot / monodepth

Unsupervised single image depth prediction with CNNs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question about paper

abeyang00 opened this issue · comments

commented

What is dense correspondence field exactly? There seems to be no explanation about this in the paper. And when i read your code, it seems like disparity is regarded as correspondence field??

Thank you in advance

Yes. For each pixel we predict a single scalar value specifying the disparity (i.e. scaled inverse depth). The "ground truth" disparity would point to the corresponding pixel in the second stereo view.

@macaodha Does the 'dl' mean the disparity of the right image in the equation(3)? Because in the paper, you indicate that the reconstructed right image(~Ir) can be obtained from left image(Il) and the disparity image(dr). For the disparity smoothness loss, you weight this cost with an edge-aware term using the image gradients. It means that the origin image should be correspondent with the disparity image in the Eq.3. But, according to the Eq.3, the 'Il ' isn't correspondent with the 'dl'.
I would really appreciate it if you could answer my question.
image
image

dl is aligned with the left image and dr with the right. We use backward mapping (B in the attached image) to reconstruct the right image from pixels in the left guided by the predicted right disparity.

image