How to project 2d feature to 3d volume?

Question

How to project 2d feature to 3d volume?

VLadImirluren opened this issue 7 months ago · comments

VLadImirluren commented 7 months ago

I am a rookie of 3d perception. Recently I start to be a reseacher in this field.

Can you tell me how you project the 2d feature to 3d volume? I can't understand, it is a ill-posed problem, isn't it?

Danila Rukhovich · Answer 1 · Mon Oct 30 2023 22:28:34 GMT+0800 (China Standard Time)

With known extrinsic and intrinsic camera matrices, there is a correspondence between a 3D point and a 2D pixel in the image. With such mapping several 3D points correspond to one 2D pixel.

VLadImirluren · Answer 2 · Tue Oct 31 2023 09:41:36 GMT+0800 (China Standard Time)

yeah, that's what I wondering about... So what's the corelation between the 3D voxel volume with 2d feature?

I mean several 3d points correspond to one 3d pixel so how did you project 2d feature to 3d volume?

According to the corresponding code, I think you extract the 3d point cloud then put them in 2d voxel volume, right?(I guess)

Thanks to your reply~

Best wishes~

Danila Rukhovich · Answer 3 · Tue Oct 31 2023 17:03:54 GMT+0800 (China Standard Time)

Sure, more formulas about this backproject function are given in section 3.1 of our paper.

VLadImirluren · Answer 4 · Tue Oct 31 2023 19:19:27 GMT+0800 (China Standard Time)

Sure, more formulas about this backproject function are given in section 3.1 of our paper.

Thanks ！Get it ~