zhigangjiang / LGT-Net

This is PyTorch implementation of our paper "LGT-Net: Indoor Panoramic Room Layout Estimation with Geometry-Aware Transformer Network".(CVPR'22)

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Test sample error

Lu-Jichen opened this issue · comments

Thank you for your previous reply!
During evaluation of the trained model there is another issue, that is the uNb9QFRL6hY_5fc8f0e230eb49eca81fdfb0398d824b sample will raise an error for wrong depth length, I am not sure is that caused by the label annotation or the dataloader code. I would like to know have you met that problem before or there is something wrong in my evaluation process. I have also tried the checkpoint on the Github but there is still the same error.

There may be a dataset preprocessing error, you can directly download our processed mp3d dataset in here (stitched skybox images and aligned vanishing points, size: 1.25 GB).

You need paste more error informations here.

Thank you for the dataset.
I used the labels of this link https://github.com/ericsujw/Matterport3DLayoutAnnotation/blob/master/label_data.zip, but it seems that the sample uNb9QFRL6hY_5fc8f0e230eb49eca81fdfb0398d824b has 4 corners in this one and 6 corners in the dataset you provide. I think that is the reason why there is an error during evaluation.

If we use the annotation of this sample uNb9QFRL6hY_5fc8f0e230eb49eca81fdfb0398d824b from https://github.com/ericsujw/Matterport3DLayoutAnnotation/blob/master/label_data.zip, Its points are shown below:
Screen Shot 2022-10-21 at 16 21 30

The camera center(x=0, z=0) is located outside the annotated points:
myplot


So we use the annotation from https://github.com/fuenwang/LayoutMP3D, Its points are shown below:
Screen Shot 2022-10-21 at 17 35 08

myplot

uNb9QFRL6hY_5fc8f0e230eb49eca81fdfb0398d824b_boundary

It was correct, so we replaced the json file for this sample.

I think that is the reason of the error, thank you for your detailed explanation!