With recent advances in camera manufacturing, light field (LF) imaging technology becomes increasingly popular and is commonly used in various applications such as mobile phones, biological microscope, VR/AR etc. Since both intensity and directions of light rays are recorded by LF cameras, the resolution of LF images can be enhanced by using these additional angular information. LF image super-resolution (SR), also known as LF spatial SR, aims at reconstructing high-resolution (HR) LF images from their low-resolution (LR) counterparts. In this repository, we present a collection of papers on LF image SR, together with their codes and repos.
Note: This repository will be updated on a regular basis, so stay tuned~~🎉 🎉 🎉
News:
We recommend our newly-released repository BasicLFSR, which is an open-source and easy-to-use toolbox for LF image SR. Both this repo and BasicLFSR are developed to make the communities better get access to this area and re-implement existing methods.
Recent Updates:
- 2022.06.14: Add a new work YingqianWang/LF-DAnet.
- 2022.02.17: Add a new work YingqianWang/DistgSSR that is accepted to TPAMI.
- 2022.01.23: Update ZhengyuLiang24/LFT that is accepted by IEEE SPL.
- 2022.01.04: Add a new work BITszwang/DPT that is accepted to AAAI 2022.
- 2021.12.09: New version is online, more recent methods are included.
Methods from 2012 to 2022:
| Acronym | Publication | Official Repo |
|---|---|---|
| The light field camera: extended depth of field, aliasing, and superresolution, TPAMI, 2012. | -- | |
| -- | Spatial and angular vriational super-resolution of 4D light fields, ECCV 2012. | -- |
| -- | Variational light field analysis for disparity estimation and super-resolution, TPAMI 2013. | -- |
| LFCNN | Learning a deep convolutional network for light-field image super-resolution, ICCVW 2015; Light field image super-resolution using convolutional neural network, SPL 2017 | youngjinYoon/ SPL_LF_SR |
| PCA_rr | Super resolution of light field images using linear subspace projection of patch-volumes, JSTSP 2017 | -- |
| LFSR_Gul | Spatial and angular resolution enhancement of light fields using convolutional neural networks, TIP 2018 | -- |
| GB | Light field super-resolution via graph-based regularization, TIP 2018 | rossimattia/ light-field-super-resolution |
| LFNet | LFNet: A Novel Bidirectional Recurrent Convolutional Neural Network for Light-Field Image Super-Resolution, TIP 2018 | wylcasia/LFNet |
| LRP | Light field super-resolution using a low-rank prior and deep convolutional neural networks, TPAMI 2018 | -- |
| LFBM5D | Light field super-resolution via LFBM5D sparse coding, ICIP 2018 | V-Sense/ LFBM5D |
| LF-DCNN | Light-field image superresolution using a combined deep CNN based on EPI， SPL 2018. | -- |
| LFSSR-SAS | Light field spatial super-resolution using deep efficient spatial-angular separable convolution, TIP 2018 | jingjin25/ LFSSR-SAS-PyTorch |
| EPGB | Light field super-resolution using edge-preserved graph-based regularization, TMM 2019. | -- |
| LF-FusNet | Light field super-resolution by jointly exploiting internal and external similarities, TCSVT 2019. | Joechann0831/ LFSR-FusNet |
| --- | An epipolar volume autoencoder with adversarial loss for deep light field super-resolution, CVPRW 2019 | MinchenZKN/ LFSR |
| resLF | Residual networks for light field image super-resolution, CVPR 2019 | shuozh/resLF |
| HDDRNet | High-dimensional dense residual convolutional neural network for light field reconstruction, TPAMI 2019 | monaen/ LightFieldReconstruction |
| LF-InterNet | Spatial-angular interaction for light field image super-resolution, ECCV 2020 | YingqianWang/ LF-InterNet |
| LF-ATO | Light field spatial super-resolution via deep combinatorial geometry embedding and structural consistency regularization, CVPR 2020 | jingjin25/ LFSSR-ATO |
| LFDCSR | Deep selective combinatorial embedding and consistency regularization for light field super-resolution, arxiv 2020 | -- |
| LF-DFnet | Light field image super-resolution using deformable convolution, TIP 2020 | YingqianWang/ LF-DFnet |
| LF-ZSSR | Light field super-resolution with zero-shot learning, CVPR 2021 | Joechann0831/ LFZSSR |
| LFSR-AFR | Light field super-resolution via adaptive feature remixing, TIP 2021. | keunsoo-ko/ LFSR-AFR |
| MEG-Net | End-to-end light field spatial super-resolution network using multiple epipolar geometry, TIP 2021. | shuozh/MEG-Net |
| DDAN | Dense dual-attention network for light field image super-resolution, TCSVT 2021. | -- |
| LF-IINet | Intra-inter view interaction network for light field image super-resolution, TMM 2021. | GaoshengLiu/ LF-IINet |
| -- | Cooperative Light-Field Image Super-Resolution based on Multi-Modality Embedding and Fusion with Frequency Attention, SPL 2021. | -- |
| DKNet | Texture-enhanced Light Field Super-resolution with Spatio-Angular Decomposition Kernels, TIM 2022. | huzexi/DKNet |
| DPT | Detail-Preserving Transformer for Light Field Image Super-Resolution, AAAI 2022. | BITszwang/DPT |
| LFT | Light field image super-resolution with Transformers, SPL 2022. | ZhengyuLiang24/LFT |
| DistgSSR | Disentangling Light Fields for Super-Resolution and Disparity Estimation, TPAMI 2022. | YingqianWang/DistgSSR |
| LF-DAnet | Learning a Degradation-Adaptive Network for Light Field Image Super-Resolution, arXiv 2022. | YingqianWang/LF-DAnet |
Acknowledgement
We would like to thank Zhengyu Liang and Zhen Cheng for the helpful discussions and insightful suggestions regarding this repository.
Contact
Any question regarding this repo can be addressed to yingqian.wang@outlook.com.