A collection of polarization-based models in computer vision. Main interest lies in scene understanding.
A curated set of papers along with code.
- CroMo: Cross-Modal Learning for Monocular Depth Estimation, (2022), CVPR, code.
- Shape from Polarization for Complex Scenes in the Wild, (2022), CVPR, code.
- Polarimetric Helmholtz Stereopsis, (2021), ICCV.
- Polarimetric Normal Stereo, (2021), CVPR.
- Shape from Sky: Polarimetric Normal Recovery Under The Sky, (2021), CVPR.
- Deep Polarization Imaging for 3D Shape and SVBRDF Acquisition, (2021), CVPR.
- Polarimetric Monocular Dense Mapping Using Relative Deep Depth Prior, (2021), RAL.
- P2D: a self-supervised method for depth estimation from polarimetry, (2020), paper, dataset
- Deep Shape from Polarization, (2020), Yunhao Ba, Alex Ross Gilbert, Franklin Wang, Jinfa Yang, Rui Chen, Yiqin Wang, Lei Yan, Boxin Shi, Achuta Kadambi. [pdf] [website], dataset
- Depth from a polarisation + RGB stereo pair, (2019), Zhu, Dizhong and Smith, William AP. [pdf] [code]
- Mirror Surface Reconstruction Using Polarization Field, (2019), ICIP
- Polarimetric Relative Pose Estimation, (2019), Cui et al.
- Depth from stereo polarization in specular scenes for urban robotics, (2017)
- Polarisation photometric stereo, (2017)
- Polarimetric three-view geometry, (2018)
- Polarimetric multi-view stereo, (2017)
- Shape and light directions from shading and polarization, (2015)
- Polarized 3d: High-quality depth sensing with polarization cues, (2015)
- Direct method for shape recovery from polarization and shading, (2012)
- Shape and refractive index recovery from single-view polarisation images, (2010)
- Shape estimation using polarization and shading from two views, (2007)
- What is the range of surface reconstructions from a gradient field, (2006)
- Recovery of surface orientation from diffuse polarization, (2006)
- Polarization imaging applied to 3D reconstruction of specular metallic surfaces, (2005)
- Transparent surface modeling from a pair of polarization images, (2004)
- Polarization-based inverse rendering from a single view, (2003)
- Separating reflections and lighting using independent components analysis, (1999)
- Multi-polarization fusion generative adversarial networks for clear underwater imaging, (2022), underwater dataset
- Polarized Reflection Removal with Perfect Alignment in the Wild, (2020), Chenyang Lei, Xuhua Huang, Mengdi Zhang, Qiong Yan, Wenxiu Sun, and Qifeng Chen. [pdf] [code], CVPR. dataset
- Reflection separation using a pair of unpolarized and polarized images, (2019)
- Image dehazing using polarization effects of objects and airlight, (2014)
- A physically-based approach to reflection separation: from physical modeling to constrained optimization, (2013)
- Clear underwater vision, (2004)
- Deep Polarization Cues for Transparent Object Segmentation, (2020), Link
- HDR Reconstruction Based on the Polarization Camera, (2020)
- A New Multimodal RGB and Polarimetric Image Dataset for Road Scenes Analysis, (2020), dataset
- Outdoor Scenes Pixel-wise Semantic Segmentation using Polarimetry and Fully Convolutional Network, (2019), datast
- Road scenes analysis in adverse weather conditions bypolarization-encoded images and adapted deep learning, (2019)
- Adapted learning for polarization-based car detection, (2019)
- Polarized Optical-Flow Gyroscope, (2020), ECCV
- Monochrome and color polarization demosaicking using edge-aware residual interpolation, (2020)
- Face Anti-Spoofing by Learning Polarization Cues in a Real-World Scenario, (2020)
- Attitude Estimation from Polarimetric Cameras, (2018)
- Survey of demosaicking methods for polarization filter array images, (2018)
- Simultaneous acquisition of polarimetric SVBRDF and normals., (2018)
- Polarization imaging reflectometry in the wild, (2017)
- Enhanced material classification using turbulence-degraded polarimetric imagery, (2010)
- Polarization phase-based method for material classification in computer vision, (1998)
- Field Guide to Polarization
- Computational Imaging Book 2022 (Section 7 Polarimetric Imaging)
- Sony polarsens[Introduction][Application]
- PolarLITIS dataset[Link]
Format: (I0, I45, I135), (S0, S1, S2),(S0, AOP, DOP) Task: Object detection Scene: road scenes
Num.:2K+ Polar-mono/RGB pCamera: Polarcam 4D Other: adverse weather conditions( foggy, sunny and cloudy) - PolarBot dataset[Link]
Format: HSV Task: semantic segmentation Scene: outdoor road scenes
Num.: 200+ Polar/BGR pCamera: Polarcam Other: with segmentation GT, data augmentation - Zhejiang university pRGB dataset_[Link]
Format: stereo polarized RGB Task: polarization information prediction Scene: road scenes
Num.: 9736 Polar/RGB pCamera: Polarcam Other: Polarization difference GT, wearable robots - synthetic foggy dataset[Link]
Task: image dehazing Scene: synthetic/outdoor Other: based on Foggy Cityscapes dataset - CroMo dataset[Link]
Task: depth estimation Scene: outdoor Other: multi-modality/large-scale
pCamera:stereo polarisation, indirect ToF, structured light depth and IMU
- deepSfP dataset[Link]
Format: 4ch_polar/object GT/normal GT Task: 3D Reconstruction Scene: objects
Num.: 300 images pCamera: Lucid Vision Phoenix Other: 33 scanned objects, indoor/outdoor sunny/outdoor cloudy - SPW dataset[Link]
Format: polar-mono/normal GT Task: 3D Reconstruction Scene: real-world
Num.: 522 images pCamera: Lucid Vision Phoenix Other: 100 different scenes, near-field depth - KAUST dataset[Link]
Format: 4ch_polar/AoLP/DoLP/HSV Task: 3D Reconstruction Scene: objects
Num.: 100 images/per polar-angle pCamera: rotating polarizer in front of a point grey color camera Other: test code available
- KAIST Dataset of polarimetric BRDF[Link]
- Polarization Human Shape and Pose Dataset[Link]
- Polarization-based Reflection Removal Dataset[Link]
- A Polarizing Filter Function for Real-Time Rendering[pdf][demo]
- Mitsuba 2: A retargetable forward and inverse renderer [Link]
- Unreal Engine: the world’s most open and advanced real-time 3D creation platform for photoreal visuals and immersive experiences. [Link][AirSim]
- A practical calibration method for RGB micro-grid polarimetric cameras, (2022)[Link]