avenger123456 / Awesome-Learning-MVS

A list of awesome learning-based multi-view stereo papers

Awesome-Learning-MVS (Methods and Datasets)

Learning-based MVS Methods

1. Volumetric methods (SurfaceNet)
2. Depthmap based methods (MVSNet/R-MVSNet and so on)

ICCV2017

• SurfaceNet: An End-to-end 3D Neural Network for Multiview Stereopsis [paper] [Github] [T-PAMI]
• Learned Multi-Patch Similarity [paper] [supp] (Note: Learning to measure multi-image patch similiarity, NOT end-to-end learning MVS pipeline)

ECCV2018

• MVSNet: Depth Inference for Unstructured Multi-view Stereo [paper] [supp] [Github]

CVPR2019

• Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inference [paper] [supp] [Github]

ICCV2019

• Point-Based Multi-View Stereo Network [paper] [supp] [Github] [T-PAMI]
• P-MVSNet: Learning Patch-wise Matching Confidence Aggregation for Multi-view Stereo [paper]
• MVSCRF: Learning Multi-view Stereo with Conditional Random Fields [paper]

AAAI2020

• Learning Inverse Depth Regression for Multi-View Stereo with Correlation Cost Volume [paper] [Github]

CVPR2020

• Cascade Cost Volume for High-Resolutoin Multi-View Stereo and Stereo Matching [paper] [Github]

• Deep Stereo using Adaptive Thin Volume Representation with Uncertainty Awareness [paper] [supp] [Github]

• Cost Volume Pyramid Based Depth Inference for Multi-View Stereo [paper] [supp] [Github]

• Fast-MVSNet: Sparse-to-Dense Multi-View Stereo with Learned Propagation and Gauss-Newton Refinement [paper] [supp] [Github]

• Attention-Aware Multi-View Stereo [paper]

• A Novel Recurrent Encoder-Decoder Structure for Large-Scale Multi-view Stereo Reconstruction from An Open Aerial Dataset [paper] [Github] [data]

ECCV2020

• Pyramid Multi-view Stereo Net with Self-adaptive View aggregation [paper] [Github]
• Dense Hybird Recurrent Multi-view Stereo Net with Dynamic Consistency Checking [paper] [Github]

BMVC2020

• Visibility-aware Multi-view Stereo Network [paper] [Github]

WACV2021

• Long-range Attention Network for Multi-View Stereo [paper]

CVPR2021

• PatchmatchNet: Learned Multi-View Patchmatch Stereo [paper] [Github]

ICCV2021

• AA-RMVSNet: Adaptive Aggregation Recurrent Multi-view Stereo Network [paper] [supp] [Github]
• EPP-MVSNet: Epipolar-Assembling Based Depth Prediction for Multi-View Stereo [paper] [Github]
• Just a Few Points are All You Need for Multi-view Stereo: A Novel Semi-supervised Learning Method for Multi-view Stereo [paper] [supp]

Journal Paper

• MVSNet++: Learning Depth-Based Attention Pyramid Features for Multi-View Stereo. IEEE TIP [paper]
• HighRes-MVSNet: A Fast Multi-View Stereo Network for Dense 3D Reconstruction From High-Resolution Images. IEEE Access [paper]
• AACVP-MVSNet: Attention-aware cost volume pyramid based multi-view stereo network for 3D reconstruction. ISPRS Journal of Photogrammetry and Remote Sensing [paper] [Github]

Survey Paper

• A Survey on Deep Learning Techniques for Stereo-based Depth Estimation. IEEE T-PAMI [ArXiv] [IEEE Xplore]
• Deep Learning for Multi-view Stereo via Plane Sweep: A Survey [paper]
• Multi-view stereo in the Deep Learning Era: A comprehensive revfiew [paper]

ArXiv Paper

• PVSNet: Pixelwise Visibility-Aware Multi-View Stereo Network [paper]
• DDR-Net: Learning Multi-Stage Multi-View Stereo With Dynamic Depth Range [paper] [Github]
• Non-local Recurrent Regularization Networks for Multi-view Stereo [paper]
• TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers [paper] [Github]

To Be Continued...

Multi-view Stereo Benchmark

• DTU [CVPR2014, IJCV2016]

  • Large-scale data for multiple-view stereopsis [paper: CVPR2014, IJCV2016] [website] [Eval code] [video]

• Tanks and Temples [ACM ToG2017]

  • Tanks and Temples: Benchmarking Large-Scale Scene Reconstruction [paper] [supp] [website] [Github] [leaderboard]

• ETH3D [CVPR2017]

  • A Multi-View Stereo Benchmark with High-Resolution Images and Multi-Camera Videos [paper] [supp] [website] [Github]

• BlendedMVS [CVPR2020]

  • BlendedMVS: A Large-Scale Dataset for Generalized Multi-View Stereo Network [paper] [supp] [Github] [visual]

Large-scale Real-world Scenes

1. Chinese Style Architectures

• http://vision.ia.ac.cn/zh/data/index.html, provided by CASIA.

2. Western Style Architectures

• https://colmap.github.io/datasets.html, provided by COLMAP.
• ImageDataset_SceauxCastle, provided by OpenMVG.

3. Aerial Dataset

• http://gpcv.whu.edu.cn/data/WHU_MVS_Stereo_dataset.html, provided by WHU.

Welcome to contribute to this Repo!

Update: WeChat Group