liuyuan-pal / Gen6D

[ECCV2022] Gen6D: Generalizable Model-Free 6-DoF Object Pose Estimation from RGB Images

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Wrong results on custom object

IAM-P-LP opened this issue · comments

Hi,
I was trying to do the reproduce these results https://github.com/liuyuan-pal/Gen6D/blob/main/custom_object.md
This is what I obtained
image
I was debugging where it went wrong.
After cropping the point cloud,this is what I got
image
Here,the yellow box which comes after cropping looks wrong.
Why the yellow box appears like this?Is there any issue in the point cloud I obtained?Can you please help on the same

Hi, it seems that there is something wrong with your coordinate system.
image
The reference image is not centered on the object. You may check whether your object point cloud is aligned with the reconstructed points from the COLMAP project.

Hi,Thanks a lot for your response.I was comparing your results and the results I got.
OBJECT_POINT_CLOUD(object_point_cloud.ply)
image

AUTHOR’S OBJECT POINT CLOUD
image

META_INFO FILE
2.610566 -0.679084 0.296952
-0.0456607 -0.562146 -0.825776
AUTHOR’S META FILE
2.396784 -0.617233 0.282476
-0.0452898 -0.550408 -0.833667

From images_inter folder,
image

It almost looks the same.Can you please comment on how to proceed.

The main reason for this could be that the object_point_cloud.ply is not in the same coordinate system as the COLMAP project i.e. mouse/colmap/sparse/0. If you run COLMAP again, then the coordinate system would change due to some randomness in the COLMAP. You could check that mouse/points.ply and mouse/object_point_cloud.ply are aligned or not. You may refer to #12 (comment)

Thankyou.. It worked!

hi, have you resolved this issue?How should I check that mouse/points.ply and mouse/object_point_cloud.ply are aligned or not?
Looking forward to your answer!