juampatronics / awesome-computational-photography

A curated list of awesome resources for topics related to computational photography via deep learning, which mainly focuses on image alignment and stitching.

Computational Photography via Deep Learning

A curated list of awesome resources for topics related to computational photography via deep learning, including but not limited to image matching, image alignment/registration, image stitching and stabilization.

❗Updated 2022-07.

---

Contents:

• Image Stitching
• Image Matching
• Image Alignment
• Color Harmonization
• Low-Light Enhancement
• Stabilization
• Beyond
• Appendix

---

Image Stitching

2022

Year	Pub.	Title	Links
--	arXiv	Warped Convolution Networks for Homography Estimation Xinrui Zhan, Jianke Zhu, et al.	Paper/Code
--	arXiv	Deep Rotation Correction without Angle Prior Lang Nie, Shuaicheng Liu, et al.	Paper/Code
--	arXiv	Natural Image Stitching Using Depth Maps Tianli Liao, Nan Li	Paper/Code
--	arXiv	Pixel-wise Deep Image Stitching Hyeokjun Kweon, et al.	Paper/Code
2022	MM	Towards All Weather and Unobstructed Multi-Spectral Image Stitching: Algorithm and Benchmark Zhiying Jiang, Zengxi Zhang, Xin Fan, Risheng Liu	Paper/Code
2022	ECCV	Weakly-Supervised Stitching Network for Real-World Panoramic Image Generation Dae-Young Song, Geonsoo Lee, HeeKyung Lee, Gi-Mun Um, Donghyeon Cho	Paper/Code
2022	CVPR	Geometric Structure Preserving Warp for Natural Image Stitching Peng Du, Jifeng Ning, et al.	Paper/Code
2022	CVPR	Automatic Color Image Stitching Using Quaternion Rank-1 Alignment Jiaxue Li, Yicong Zhou	Paper/Code
2022	CVPR	Deep Rectangling for Image Stitching: A Learning Baseline Lang Nie, Chunyu Lin, et al.	Paper/Code
2022	CVPR	Unsupervised Homography Estimation With Coplanarity-Aware GAN Mingbo Hong, Shuaicheng Liu, et al.	Paper/Code
2022	CVPR	Iterative Deep Homography Estimation Si-Yuan Cao, Jianxin Hu, et al.	Paper/Code
2022	TCSVT	Depth-Aware Multi-Grid Deep Homography Estimation with Contextual Correlation Lang Nie, Shuaicheng Liu, et al.	Paper/Code
2022	NeuCom	Learning edge-preserved image stitching from multi-scale deep homography Lang Nie, Chunyu Lin, et al.	Paper/Code

2021

Year	Pub.	Title	Links
2021	ICCV	Minimal Solutions for Panoramic Stitching Given Gravity Prior Yaqing Ding, Daniel Barath, Zuzana Kukelova	Paper/Code
2021	ICCV	Motion Basis Learning for Unsupervised Deep Homography Estimation with Subspace Projection DH Nianjin Ye, Shuaicheng Liu, et al.	Paper/Code
2021	CVPR	Leveraging Line-Point Consistence To Preserve Structures for Wide Parallax Image Stitching  Qi Jia, ZhengJun Li, et al.	Paper/Code
2021	CVPR	Deep Lucas-Kanade Homography for Multimodal Image Alignment Yiming Zhao, Xinming Huang, Ziming Zhang	Paper/Code
2021	CVPR	Deep Homography for Efficient Stereo Image Compression Xin Deng, Mai Xu, et al.	Paper/Code
2021	PAMI	Rolling Shutter Homography and its Applications Yizhen Lao, Omar Ait-Aider	Paper/Code
2021	TIP	Unsupervised Deep Image Stitching: Reconstructing Stitched Features to Images DH Lang Nie, Shuaicheng Liu, et al.	Paper/Code
2021	TIP	Image Stitching Based on Semantic Planar Region Consensus Aocheng Li, Jie Guo, Yanwen Guo	Paper/Code
2021	TVCG	Content-Preserving Image Stitching With Piecewise Rectangular Boundary Constraints Yun Zhang, Yu-Kun Lai, Fang-Lue Zhang	Paper/Code
2021	PR	Edge-guided Composition Network for Image Stitching Qinyan Dai, Faming Fang, Juncheng Li, Guixu Zhang, Aimin Zhou	Paper/Code
2021	PR	Image stitching based on angle-consistent warping Yinqi Chen, Huicheng Zheng, Yiyan Ma, Zhiwei Yan	Paper/Code
2021	SPL	End-to-End Image Stitching Network via Multi-Homography Estimation Dae-Young Song, et al.	Paper/Code
2021	NeuCom	Image stitching via deep homography estimation Qiang Zhao, Yike Ma, Chen Zhu, Chunfeng Yao, Bailan Feng, Feng Dai	Paper/Code

2020

Year	Pub.	Title	Links
--	arXiv	Vanishing Point Guided Natural Image Stitching Kai Chen, Jian Yao, et al.	Paper/Proj
2020	ECCV	Image Stitching and Rectification for Hand-Held Cameras Bingbing Zhuang, Quoc-Huy Tran	Paper/Proj
2020	ECCV	Content-Aware Unsupervised Deep Homography Estimation DH Jirong Zhang, Shuaicheng Liu, et al.	Paper/Code
2020	MM	SRHEN: Stepwise-Refining Homography Estimation Network via Parsing Geometric Correspondences in Deep Latent Space Yi Li, Wenjie Pei, Zhenyu He	Paper/Code
2020	CVPR	Warping Residual Based Image Stitching for Large Parallax  Kyu-Yul Lee, Jae-Young Sim	Paper/Code
2020	CVPR	Deep Homography Estimation for Dynamic Scenes DH Hoang Le, Feng Liu, et al.	Paper/Code
2020	CVPR	Robust Homography Estimation via Dual Principal Component Pursuit Tianjiao Ding, et al.	Paper/Code
2020	PAMI	CrossNet++: Cross-scale Large-parallax Warping for Reference-based Super-resolution Yang Tan, et al.	Paper/Code
2020	TIP	Parallax Tolerant Light Field Stitching for Hand-Held Plenoptic Cameras Xin Jin, Pei Wang, Qionghai Dai	Paper/Code
2020	TIP	An Unordered Image Stitching Method Based on Binary Tree and Estimated Overlapping Area Zhong Qu, et al.	Paper/Code
2020	TIP	Single-Perspective Warps in Natural Image Stitching Tianli Liao, Nan Li	Paper/Code1 Code2
2020	TMM	Stereoscopic Image Stitching via Disparity-Constrained Warping and Blending Xiaoting Fan, et al.	Paper/Code
2020	TMM	Image-Only Real-Time Incremental UAV Image Mosaic for Multi-Strip Flight Fangbing Zhang, et al.	Paper/Code
2020	JSTSP	Attentive Deep Stitching and Quality Assessment for 360° Omnidirectional Images Jia Li, et al.	Paper/Code

2019

Year	Pub.	Title	Links
2019	ICCV	Homography From Two Orientation- and Scale-Covariant Features Daniel Barath, Zuzana Kukelova	Paper/Code
2019	BMVC	Video Stitching for Linear Camera Arrays CNNStitch Wei-Sheng Lai, et al.	Paper/arXiv Proj
2019	TIP	Robust Alignment for Panoramic Stitching Via an Exact Rank Constraint Yuelong Li, Mohammad Tofighi, Vishal Monga	Paper/Code
2019	TMM	A Novel Projective-Consistent Plane Based Image Stitching Method Jin Zheng, et al.	Paper/Code
2019	TMM	Shape-Optimizing and Illumination-Smoothing Image Stitching  Shiguang Liu, Qingpeng Chai	Paper/Code
2019	GRSM	Remote Sensing Image Mosaicking: Achievements and Challenges Xinghua Li, Ruitao Feng, et al.	Paper/Code

2018

Year	Pub.	Title	Links
2018	ECCV	Object-centered image stitching Charles Herrmann, Ramin Zabih, et al.	Paper/Code
2018	ECCV	Robust image stitching with multiple registrations Herrmann, Charles, Zabih, Ramin, et al.	Paper/Code
2018	TIP	Dynamic Video Stitching via Shakiness Removing Yongwei Nie, et al.	Paper/Code
2018	TMM	Parallax-Tolerant Image Stitching Based on Robust Elastic Warping Jing Li, Zhengming Wang, Shiming Lai, Yongping Zhai, Maojun Zhang	Paper/Code
2018	TMM	Quasi-Homography Warps in Image Stitching Nan Li, Yifang Xu, Chao Wang	Paper/Code
2018	PR	Image Stitching by Line-guided Local Warping with Global Similarity Constraint Tian-Zhu Xiang, Gui-Song Xia, Xiang Bai, Liangpei Zhang	Paper/Code
2018	RA-L	Unsupervised deep homography: A fast and robust homography estimation model DH Ty Nguyen, et al.	Paper/Code

2017

Year	Pub.	Title	Links
2017	ICCVW	Homography Estimation from Image Pairs with Hierarchical Convolutional Networks DH F E Nowruzi, et al.	Paper/Code
2017	CVPR	Direct Photometric Alignment by Mesh Deformation Kaimo Lin, Shuaicheng Liu, et al.	Paper/Code

2016

Year	Pub.	Title	Links
2016	RSS-W	Deep Image Homography Estimation DH Daniel DeTone, et al.	Paper/Code
2016	ECCV	SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching Kaimo Lin, Nianjuan Jiang, et al.	Paper/Proj
2016	ECCV	Natural Image Stitching with the Global Similarity Prior Y.-S. Chen, Yung-Yu Chuang	Paper/Code
2016	TOG	Jump: Virtual reality video Robert Anderson, et al.	Paper/Code

2015 & before

Year	Pub.	Title	Links
2015	ICCV	Dual-Feature Warping-Based Motion Model Estimation Shiwei Li, Lu Yuan, Jian Sun, Long Quan	Paper/Code
2015	CVPR	Adaptive As-Natural-As-Possible Image Stitching Chung-Ching Lin, S. U. Pankanti, K. N. Ramamurthy, and Aleksandr Y. Aravkin	Paper/Code
2014	CVPR	Shape-preserving half-projective warps for image stitching Che-Han Chang, Yoichi Sato, Yung-Yu Chuang	Paper/Code
2014	CVPR	Parallax-tolerant Image Stitching Fan Zhang and Feng Liu	Paper
2013	CVPR	As-Projective-As-Possible Image Stitching with Moving DLT Julio Zaragoza, Tat-Jun Chin, Michael S. Brown, David Suter	Paper/Code Ext
2013	EG	Seam-Driven Image Stitching Junhong Gao, Yu Li, Tat-Jun Chin, Michael S. Brown	Paper/Code
2012	TOG	Panorama weaving: fast and flexible seam processing Brian Summa, et al.	Paper/Proj
2011	CVPR	Smoothly varying affine stitching Wen-Yan Lin, Siying Liu, Y Matsushita, Tian-Tsong Ng, Loong-Fah Cheong	Paper/Code
2011	CVPR	Constructing image panoramas using dual-homography warping Junhong Gao, Seon Joo Kim, Michael S. Brown	Paper/Code
2007	IJCV	Automatic panoramic image stitching using invariant features Matthew Brown and David G. Lowe	Paper/Demo
2006	FTCGV	Image alignment and stitching: a tutorial Richard Szeliski	Paper

Stitching Evaluation

Year	Pub.	Title	Links
2019	MM	Cross-Reference Stitching Quality Assessment for 360° Omnidirectional Images Jia Li, et al.	Paper/Proj
2020	TIP	A Metric for Video Blending Quality Assessment Zhe Zhu, et al.	Paper/Code
2019	TIP	Subjective and Objective Quality Assessment of Stitched Images for Virtual Reality  Pavan C. Madhusudana, Rajiv Soundararajan	Paper/Code

Stitching Beyond

Year	Pub.	Title	Links
2018	ECCV	GridFace: Face Rectification via Learning Local Homography Transformations   Erjin Zhou, Zhimin Cao, Jian Sun	Paper/Code
2020	PAMI	Ambiguity-Free Radiometric Calibration for Internet Photo Collections Zhipeng Mo, Yasuyuki Matsushit, et al.	Paper/Code
2019	TOG	Video Extrapolation Using Neighboring Frames Sangwoo Lee, et al.	Paper/Code
2019	TIP	Panoramic Background Image Generation for PTZ Cameras  Hongwei Yong, et al.	Paper/Code

Image Matching

Part curated paper list for deep learning-based image matching.

Overview

Year	Pub.	Title	Author	Links
2021	IJCV	Image Matching from Handcrafted to Deep Features: A Survey	Jiayi Ma, Xingyu Jiang, et al.	Paper/Code
2021	INFFUS	A review of multimodal image matching: methods and applications	Xingyu Jiang, Jiayi Ma, et al.	Paper/Data
2021	ICCV	Matching in the Dark: A Dataset for Matching Image Pairs of Low-light Scenes	W. Song, Takayuki Okatani, et al.	Paper/Code

2022

Pub.	Title	Author	Links
ECCV	ECO-TR: Efficient Correspondences Finding Via Coarse-to-Fine Refinement	Dongli Tan, Rongrong Ji, et al.	Paper/Code
AAAI	Guide Local Feature Matching by Overlap Estimation	Ying Chen, Dihe Huang, et al.	Paper/Code

2021

Pub.	Title	Author	Links
PAMI	Joint detection and matching of feature points in multimodal images	Elad Ben Baruch, Yosi Keller	Paper/Code
TIP	Multi-Relation Attention Network for Image Patch Matching	Dou Quan, et al.	Paper/Code
ICCV	COTR: Correspondence Transformer for Matching Across Images	Wei Jiang, Eduard Trulls, et al.	Paper/Code
ICCV	Warp Consistency for Unsupervised Learning of Dense Correspondences	Prune Truong, Luc Van Gool, et al.	Paper/Code
CVPR	LoFTR: Detector-Free Local Feature Matching with Transformers	Jiaming Sun, Xiaowei Zhou, et al.	Paper/Code Proj
CVPR	SOLD2: Self-supervised Occlusion-aware Line Description and Detection	Rémi Pautrat, Marc Pollefeys, et al.	Paper/Code
CVPR	Convolutional Hough Matching Networks		Paper/Proj
CVPR	Learning to Match Features with Seeded Graph Matching Network		Paper/Code
CVPR	Co-Attention for Conditioned Image Matching	Olivia Wiles, S. Ehrhardt, Andrew Zisserman	Paper/Proj
CVPR	Learning Optical Flow From a Few Matches	Shihao Jiang, Yao Lu, Hongdong Li, Richard Hartley	Paper/Code
CVPR	SuperGlue: Learning Feature Matching With Graph Neural Networks	P. Sarlin, D. DeTone, T. Malisiewicz, Andrew Rabinovich	Paper/Code arXiv
CVPR	Patch2Pix: Epipolar-Guided Pixel-Level Correspondences	Qunjie Zhou, Torsten Sattler, Laura Leal-Taixe	Paper/Code

2020

Pub.	Title	Author	Links
IJCV	Is There Anything New to Say About SIFT Matching?	Fabio Bellavia, Carlo Colombo	Paper/Code
TIP	Robust Feature Matching Using Spatial Clustering with Heavy Outliers	Xingyu Jiang, Jiayi Ma	Paper/Code
TIP	Image Feature Correspondence Selection: A Comparative Study and a New Contribution	Chen Zhao, et al.	Paper/Code
TIP	A Grassmannian Graph Approach to Affine Invariant Feature Matching	Mark Moyou, et al.	Paper/Code

2019

Pub.	Title	Author	Links
IJCV	Locality Preserving Matching	Jiayi Ma, et al.	Paper/Code
IJCV	Cross-Domain Image Matching with Deep Feature Maps	Bailey Kong, et al.	Paper/Code
ICCV	Deep Matching Prior: Test-Time Optimization for Dense Correspondence	Sunghwan Hong, Seungryong Kim	Paper/Code
ICCV	AFD-Net: Aggregated Feature Difference Learning for Cross-Spectral Image Patch Matching	Dou Quan, Licheng Jiao, et al.	Paper/Code
ICCV	GLAMpoints: Greedily Learned Accurate Match Points
ICCV	Fully Convolutional Geometric Features	Christopher Choy, Jaesik Park, Vladlen Koltun	Paper/Code

2018

Pub.	Title	Author	Links
TIP	Automatic Registration of Images With Inconsistent Content Through Line-Support Region Segmentation and Geometrical Outlier Removal	Ming Zhao, et al.	Paper/Code
TGRS	Guided Locality Preserving Feature Matching for Remote Sensing Image Registration	Jiayi Ma, Junjun Jiang, et al.	Paper/Code
CVPR	On the Convergence of PatchMatch and Its Variants		Paper/Code
CVPR	Learning to Detect Features in Texture Images		Paper/Code

2017

Pub.	Title	Author	Links
TIP	Establishing Keypoint Matches on Multimodal Images With Bootstrap Strategy and Global Information	Yong Li, Hongbin Jin, Jiatao Wu, Jie Liu	Paper/Code
ICCV	Progressive Large Scale-Invariant Image Matching in Scale Space	Lei Zhou, Long Quan	Paper/Code
ICCV	Practical and Efficient Multi-View Matching		Paper/Code
ICCV	Misalignment-Robust Joint Filter for Cross-Modal Image Pairs		Paper/Code
CVPR	Convolutional neural network architecture for geometric matching	I. Rocco, R. Arandjelović, J. Sivic	Paper/PAMI19 Code
CVPR	Deep Semantic Feature Matching		Paper/Code
CVPR	HPatches: A Benchmark and Evaluation of Handcrafted and Learned Local Descriptors	Vassileios Balntas, et al.	Paper/Proj

2016

Pub.	Title	Author	Links
ECCV	LIFT: Learned Invariant Feature Transform	K. M. Yi, Pascal Fua, et al.	Paper/Code
ECCV	Learning Image Matching by Simply Watching Video		Paper/Code
ECCV	Novel Coplanar Line-Points Invariants for Robust Line Matching Across Views		Paper/Code
ECCV	Deep Self-correlation Descriptor for Dense Cross-Modal Correspondence	S. Kim, Dongbo Min, S. Lin, Kwanghoon Sohn	Paper/Code

Image Alignment

Image Registration

Year	Pub.	Title	Author	Links
2021	arXiv07	Precise Aerial Image Matching based on Deep Homography Estimation		Paper/Code
2021	arXiv05	Attention for Image Registration (AiR): an unsupervised Transformer approach	Zihao Wang, Hervé Delingette	Paper/Code
2021	CVPR	Learning-based Image Registration with Meta-Regularization	Ebrahim Al Safadi, Xubo Song	Paper/Code
2020	TIP	Cross-Weather Image Alignment via Latent Generative Model with Intensity Consistency	Huabing Zhou, Jiayi Ma, et al.	Paper/Code
2020	TIP	Boosting Structure Consistency for Multispectral and Multimodal Image Registration	Si-Yuan Cao, Hui-Liang Shen, Shu-Jie Chen, Chunguang Li	Paper/Code
2020	TIP	Local-Adaptive Image Alignment Based on Triangular Facet Approximation	Jing Li, et al.	Paper/Code
2020	ECCV	RANSAC-Flow: Generic Two-stage Image Alignment		Paper/Code
2020	ECCV	Aligning Videos in Space and Time		Paper/Code
2020	CVPR	Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation	Moab Arar, Yiftach Ginger, et al.	Paper/Code
2019	TIP	Online Subspace Learning from Gradient Orientations for Robust Image Alignment	Qingqing Zheng, Yi Wang, Pheng Ann Heng	Paper/Code
2019	ICCV	Jointly Aligning Millions of Images With Deep Penalised Reconstruction Congealing	Roberto Annunziata, Christos Sagonas, Jacques Cali	Paper/Code
2018	PAMI	Hierarchical Sparse Representation for Robust Image Registration	Yeqing Li, et al.	Paper/Code
2018	ISPRSJ	A deep learning framework for remote sensing image registration	Shuang Wang, Licheng Jiao, et al.	Paper/Code
2018	ECCV	Multimodal image alignment through a multiscale chain of neural networks with application to remote sensing		Paper/Code
2017	CVPR	CLKN: Cascaded Lucas-Kanade Networks for Image Alignment	Che-Han Chang, Chun-Nan Chou, Edward Y. Chang	Paper/Code

Medical Registration

Year	Pub.	Title	Author	Links
2020	ECCV	Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Images	Yuting He, et al.	Paper/Code
2020	CVPR	DeepFLASH: An Efficient Network for Learning-based Medical Image Registration	Jian Wang, Miaomiao Zhang	Paper/Code
2020	CVPR	Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networks	Tony C.W. Mok, Albert C.S. Chung	Paper/Code
2019	ICCV	Recursive Cascaded Networks for Unsupervised Medical Image Registration	Shengyu Zhao, Yue Dong, et al.	Paper/Code
2019	CVPR	Networks for Joint Affine and Non-parametric Image Registration	Zhengyang Shen, Xu Han, et al.	Paper/Code
2019	CVPR	Metric Learning for Image Registration	M. Niethammer, R. Kwitt, François-Xavier Vialard	Paper/Code
2018	CVPR	An Unsupervised Learning Model for Deformable Medical Image Registration	Guha Balakrishnan, et al.	Paper/Code

Color Harmonization

Year	Pub.	Title	Author	Links
2021	ICCV	Image Harmonization With Transformer	Zonghui Guo, Dongsheng Guo, et al.	Paper/Code

Low-Light Enhancement

Year	Pub.	Title	Author	Links
2021	arXiv04	Low-Light Image and Video Enhancement Using Deep Learning: A Survey	Chongyi Li, Chen Change Loy, et al.	Paper/Proj

Stabilization

Year	Pub.	Title	Author	Links
2021	ICCV	Out-of-boundary View Synthesis Towards Full-Frame Video Stabilization	Yufei Xu, Jing Zhang, Dacheng Tao	Paper/Code
2021	ICCV	Hybrid Neural Fusion for Full-Frame Video Stabilization	Yu-Lun Liu, Wei-Sheng Lai, et al.	Paper/Code Proj
2021	CVPR	Real-Time Selfie Video Stabilization		Paper/Code
2021	CVPR	Digital Gimbal: End-to-End Deep Image Stabilization With Learnable Exposure Times		Paper/Code
2020	TIP	PWStableNet: Learning Pixel-Wise Warping Maps for Video Stabilization	Minda Zhao;Qiang Ling	Paper/Code
2020	CVPR	Learning Video Stabilization Using Optical Flow		Paper/Code
2019	CVPR	Robust Video Stabilization by Optimization in CNN Weight Space	J. Yu, Ravi Ramamoorthi	Paper/Code
2019	SIGA	Deep Iterative Frame Interpolation for Full-frame Video Stabilization		Paper/Code
2019	TIP	Deep Online Video Stabilization With Multi-Grid Warping Transformation Learning	Miao Wang, et al.	Paper/Code
2019	TOG	Joint Stabilization and Direction of 360° Videos	C. Tang, Feng Liu, et al.	Paper/Code
2018	ECCV	Selfie Video Stabilization		Paper/Code
2018	CGF	Deep Video Stabilization Using Adversarial Networks	Sen-Zhe Xu, Jun Hu, et al.	Paper/Code

Beyond

Year	Pub.	Title	Author	Links
2021	arXiv10	InfinityGAN: Towards Infinite-Pixel Image Synthesis	C. Lin, Ming-Hsuan Yang, et al.	Paper/Code
2021	PAMI	CrossNet++: Cross-Scale Large-Parallax Warping for Reference-Based Super-Resolution	Yang Tan, et al.	Paper/Code

Appendix

• Awesome Image Alignment and Stitching