facebookresearch / DVSR

DVSR ("Consistent Direct Time-of-Flight Video Depth Super-Resolution"), CVPR 2023

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Experiments on realworld DTOF DataSet

xhchen10 opened this issue · comments

Hi, thanks for the wonderful job. Have you conduct experiments on real-world dTOF histogram?

Hi, Thanks a lot for your interest in our work! Unfortunately this work is conducted at Meta Reality Labs and due to the privacy policy of depth sensor vendors, we can't publish real-world evaluation results.
To "evaluate" on real-world data, I would suggest to use Apple ARKitScenes dataset, and naively downsample (with confidence mask) to synthesize a lower resolution, and real-world depth sensor data. Note that this evaluation is only for depth based super-resolution (DVSR), not the histogram based super-resolution (HVSR). We just updated the repo. Please refer to "dvsr_arkit.ipynb" for more details.

Is "real-world depth sensor data" referred as the depth maps rather than the histograms? Thanks a lot!

Hi, the "real-world depth sensor data" refers to downsampled ARKit depth map. This downsampling also involves the confidence map from ARKit. But yes, this is only for depth map (DVSR), not for histogram (HVSR)

Thanks for the quick reply.