This is a collection of documents and topics NeRF & Beyond channel accumulated, as well as papers in literaure. This is still far from complete info regarding to this active research area.
Some papers we discussed in the group, will be added to the back of the paper with a Notes link. You can follow the link to check whether there is topic you are interested in. If not, welcome to join us and ask the question to the crowd. The mighty community might have your answers.
We are actively maintaining this page trying to stay up-to-date and gather important works in a daily basis. We would also like to put as many notes as possible to some works, trying to make it easier to catch up.
Please feel free to join us on WeChat group or start a discussion topic here.
For now, you can join us in the following ways
- Bilibili Channel where we post near daily updates (primarily) on NeRF.
- WeChat group, due to the limitation of WeChat group, you can add my personal account:
jiheng_yang, and I will add you to the chat groups. - If you want to view this from a timeline perspective, please refer to this ProcessOn Diagram
- If you think something is not correct or you think we could do better in some way, please write to us through all possible channels or drop an issue. All suggestions are appreciated!
- For other discussed techniques that's related to 3D reconstruction and NeRF, please refer to link, we are constantly trying to add more resource to this document.
- We are trying to gradually setup Discord channels, join the Discord Channel if you want to, we will certainly look forward to talk with you guys!
Recently there are lots of 3D Gaussian Splatting related work released. We move all related work to a new document for tracking in parallel.
- New to NeRF
- NeRF Fundamental Enhancements
- Activation Function Optimization
- Positional Encoding
- Robust Reconstruction & Depth Supervised Reconstruction
- Deformable & Dynamic NeRF
- NeRF Training and Rendering Speed Enhancements
- One-Shot/Few-Shot Sparse View Reconstruction
- Camera Pose Estimation & Weak Camera Pose Reconstruction
- Text to 3D
- Diffusion Based NeRF Reconstruction
- Generalization
- Model Compression
- NeRF Based 2D High Quality Image Synthesis
- SDF Based Reconstruction / Other Geometry Based Reconstruction
- NeRF + Hardware Acceleration
- NeRF + Point Cloud / LiDAR
- NeRF + Auto Data Collection
- NeRF + Avatar/Talking Head
- NeRF + Imaging Tasks
- NeRF + Large Scale Scenes & Urban Scenes
- NeRF + Editing
- NeRF + Open Surface Reconstruction and Cloth Simulation
- NeRF + Segmentation
- NeRF + Mesh Extraction
- NeRF + Codec/Streaming
- NeRF + Model Conversion
- NeRF + Medical/Biology
- NeRF + Inverse Rendering
- NeRF + Texture Synthesis
- NeRF + Transparent Object Synthesis
- NeRF + Other Applications
- NeRF + Quality Metric
- NeRF + CAD
- NeRF + GIS
- NeRF + Satellite Images
- NeRF + Copyright Protection & Security
- NeRF + Motion Detection
- Datasets
- Neural Surface Reconstruction
🔥NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, Ren Ng
ECCV 2020, 19 Mar 2020
[arXiv] [Project] [Code] [PyTorch Impl] [Notes]
🔥State of the Art on Neural Rendering
Ayush Tewari, Ohad Fried, Justus Thies, Vincent Sitzmann, Stephen Lombardi, Kalyan Sunkavalli, Ricardo Martin-Brualla, Tomas Simon, Jason Saragih, Matthias Nießner, Rohit Pandey, Sean Fanello, Gordon Wetzstein, Jun-Yan Zhu, Christian Theobalt, Maneesh Agrawala, Eli Shechtman, Dan B Goldman, Michael Zollhöfer
ECCV 2020,8 Apr 2020
[arXiv]
🔥Advances in Neural Rendering
Ayush Tewari, Justus Thies, Ben Mildenhall, Pratul Srinivasan, Edgar Tretschk, Yifan Wang, Christoph Lassner, Vincent Sitzmann, Ricardo Martin-Brualla, Stephen Lombardi, Tomas Simon, Christian Theobalt, Matthias Niessner, Jonathan T. Barron, Gordon Wetzstein, Michael Zollhoefer, Vladislav Golyanik
ECCV 2022, 10 Nov 2021
[arXiv]
🔥NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review
Kyle Gao, Yina Gao, Hongjie He, Dening Lu, Linlin Xu, Jonathan Li
TPAMI 2022, 1 Oct 2022
[arXiv]
Neural Radiance Fields: Past, Present, and Future
Ansh Mittal
In Progress,20 Apr 2023
[arXiv]
🔥Neural Rendering Course
SIGGRAPH 2021 [BiliBili]
🔥Neural Volumetric Rendering for Computer Vision
ECCV 2022 Tutorial [Website]
🔥Scaling NeRF Up and Down: Big Scenes and Real-Time View Synthesis
I3D 2023 Keynote [Video]
🔥Nerfstudio: A Modular Framework for Neural Radiance Field Development
Matthew Tancik, Ethan Weber, Evonne Ng, Ruilong Li, Brent Yi, Justin Kerr, Terrance Wang, Alexander Kristoffersen, Jake Austin, Kamyar Salahi, Abhik Ahuja, David McAllister, Angjoo Kanazawa
arXiv preprint, 8 Feb 2023
Nerfstudio provides a simple API that allows for a simplified end-to-end process of creating, training, and visualizing NeRFs. The library supports an interpretable implementation of NeRFs by modularizing each component.
🔥NerfAcc: Efficient Sampling Accelerates NeRFs
Ruilong Li, Hang Gao, Matthew Tancik, Angjoo Kanazawa
arXiv preprint, 8 May 2023
NerfAcc is a PyTorch Nerf acceleration toolbox for both training and inference. It focus on efficient sampling in the volumetric rendering pipeline of radiance fields, which is universal and plug-and-play for most of the NeRFs. With minimal modifications to the existing codebases, Nerfacc provides significant speedups in training various recent NeRF papers. And it is pure Python interface with flexible APIs!
🔥threestudio: A unified framework for 3D content generation
Yuan-Chen Guo and Ying-Tian Liu and Chen Wang and Zi-Xin Zou and Guan Luo and Chia-Hao Chen and Yan-Pei Cao and Song-Hai Zhang
Github repo,2023
threestudio is a unified framework for 3D content creation from text prompts, single images, and few-shot images, by lifting 2D text-to-image generation models.
[Github]
🔥NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections
Ricardo Martin-Brualla, Noha Radwan, Mehdi S. M. Sajjadi, Jonathan T. Barron, Alexey Dosovitskiy, Daniel Duckworth
CVPR 2021, 5 Aug 2020
[arXiv] [Project]
🔥Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
Jonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, Pratul P. Srinivasan
ICCV 2021, 24 Mar 2021
[arXiv] [Project] [Github] [Notes]
🔥Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
Jonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, Peter Hedman
CVPR 2022, 23 Nov 2021
[arXiv] [Project] [Github] [Notes]
🔥Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields
Dor Verbin, Peter Hedman, Ben Mildenhall, Todd Zickler, Jonathan T. Barron, Pratul P. Srinivasan
CVPR 2022, 7 Dec 2021
[arXiv] [Project] [Github]
🔥PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo
Wenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen, Kwan-Yee K. Wong
ECCV 2022, 23 Jul 2022
[arXiv] [Project] [Github]
4K-NeRF: High Fidelity Neural Radiance Fields at Ultra High Resolutions
Zhongshu Wang, Lingzhi Li, Zhen Shen, Li Shen, Liefeng Bo
arXiv preprint, 9 Dec 2022
[arXiv] [Project] [Github]
🔥Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields
Jonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, Peter Hedman
arXiv preprint, 13 Apr 2023
[arXiv] [Project] [Unofficial Impl] [Notes]
Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFs
Frederik Warburg, Ethan Weber, Matthew Tancik, Aleksander Holynski, Angjoo Kanazawa
arXiv preprint, 20 Apr 2023
[arXiv] [Project] [Github] [Video]
Multi-Space Neural Radiance Fields
Ze-Xin Yin, Jiaxiong Qiu, Ming-Ming Cheng, Bo Ren
CVPR 2023, 7 May 2023
[arXiv] [Project] [Github] [Video] [Notes]
NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Support
Xinyue Wei, Fanbo Xiang, Sai Bi, Anpei Chen, Kalyan Sunkavalli, Zexiang Xu, Hao Su
arXiv preprint, 26 May 2023
[arXiv] [Project] [Video]
Analyzing the Internals of Neural Radiance Fields
Lukas Radl, Andreas Kurz, Markus Steinberger
arXiv preprint, 1 Jun 2023
[arXiv] [Project]
GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fields
Barbara Roessle, Norman Müller, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder, Matthias Nießner
arXiv preprint, 9 Jun 2023
[arXiv] [Video]
HyP-NeRF: Learning Improved NeRF Priors using a HyperNetwork
Bipasha Sen, Gaurav Singh, Aditya Agarwal, Rohith Agaram, K Madhava Krishna, Srinath Sridhar
arXiv preprint, 9 Jun 2023
[arXiv]
🔥Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fields
Wenbo Hu, Yuling Wang, Lin Ma, Bangbang Yang, Lin Gao, Xiao Liu, Yuewen Ma
ICCV 2023, 21 Jul 2023
[arXiv] [Project] [Video]
Bayes' Rays: Uncertainty Quantification for Neural Radiance Fields
Lily Goli, Cody Reading, Silvia Selllán, Alec Jacobson, Andrea Tagliasacchi
arXiv preprint, 6 Sep 2023
[arXiv] [Project]
ResFields: Residual Neural Fields for Spatiotemporal Signals
Marko Mihajlovic, Sergey Prokudin, Marc Pollefeys, Siyu Tang
arXiv preprint, 1 Oct 2023
[arXiv] [Project] [Github]
NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functions
Zhang Chen, Zhong Li, Liangchen Song, Lele Chen, Jingyi Yu, Junsong Yuan, Yi Xu
ICCV 2023, 27 Sep 2023
[arXiv] [Project] [Github]
Multi-task View Synthesis with Neural Radiance Fields
Shuhong Zheng, Zhipeng Bao, Martial Hebert, Yu-Xiong Wang
ICCV 2023, 29 Sep 2023
[arXiv] [Project] [Github]
Hyb-NeRF: A Multiresolution Hybrid Encoding for Neural Radiance Fields
Yifan Wang, Yi Gong, Yuan Zeng
arXiv preprint, 21 Nov 2023
[arXiv]
VQ-NeRF: Vector Quantization Enhances Implicit Neural Representations
Yiying Yang, Wen Liu, Fukun Yin, Xin Chen, Gang Yu, Jiayuan Fan, Tao Chen
AAAI 2024, 23 Oct 2023
[arXiv]
Rethinking Directional Integration in Neural Radiance Fields
Congyue Deng, Jiawei Yang, Leonidas Guibas, Yue Wang
arXiv preprint, 28 Nov, 2023
[arXiv]
🔥Depth-supervised NeRF: Fewer Views and Faster Training for Free
Kangle Deng, Andrew Liu, Jun-Yan Zhu, Deva Ramanan
CVPR 2022, 6 Jul 2021
[arXiv] [Project] [Github]
🔥NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo
Yi Wei, Shaohui Liu, Yongming Rao, Wang Zhao, Jiwen Lu, Jie Zhou
ICCV 2021, 2 Sep 2021
[arXiv] [Project] [Github]
Dense Depth Priors for Neural Radiance Fields from Sparse Input Views
Barbara Roessle, Jonathan T. Barron, Ben Mildenhall, Pratul P. Srinivasan, Matthias Nießner
CVPR 2022, 6 Dec 2021
[arXiv] [Project] [Github]
RobustNeRF: Ignoring Distractors with Robust Losses
Sara Sabour, Suhani Vora, Daniel Duckworth, Ivan Krasin, David J. Fleet, Andrea Tagliasacchi
arXiv preprint, 2 Feb 2023
[arXiv] [Project]
Digging into Depth Priors for Outdoor Neural Radiance Fields
Chen Wang, Jiadai Sun, Lina Liu, Chenming Wu, Zhelun Shen, Dayan Wu, Yuchao Dai, Liangjun Zhang
ACMMM 2023, 8 Aug 2023
[arXiv] [Project]
AltNeRF: Learning Robust Neural Radiance Field via Alternating Depth-Pose Optimization
Kun Wang, Zhiqiang Yan, Huang Tian, Zhenyu Zhang, Xiang Li, Jun Li, Jian Yang
arXiv preprint, 19 Aug 2023
[arXiv]
🔥Implicit Neural Representations with Periodic Activation Functions
Vincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell, Gordon Wetzstein
NeurIPS 2020, 17 Jun 2020
[arXiv]
Multiplicative Filter Networks
Rizal Fathony, Anit Kumar Sahu, Devin Willmott, J Zico Kolter
ICLR 2021, 13 Jan 2021
[OpenReview]
PREF: Phasorial Embedding Fields for Compact Neural Representations
Binbin Huang, Xinhao Yan, Anpei Chen, Shenghua Gao, Jingyi Yu
arXiv preprint, 26 May 2022
[avXiv]
Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domains
Matthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T. Barron, Ren Ng
arXiv preprint, 18 Jun 2020
[arXiv]
BACON: Band-limited Coordinate Networks for Multiscale Scene Representation
David B. Lindell, Dave Van Veen, Jeong Joon Park, Gordon Wetzstein
CVPR 2022, 9 Dec 2021
[arXiv] [Project]
🔥Nerfies: Deformable Neural Radiance Fields
Keunhong Park, Utkarsh Sinha, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Steven M. Seitz, Ricardo Martin-Brualla
ICCV 2021, 25 Nov 2020
[arXiv] [Project] [Github]
Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes
Zhengqi Li, Simon Niklaus, Noah Snavely, Oliver Wang
CVPR 2021, 26 Nov 2020
[arXiv] [Project] [Github]
HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields
Keunhong Park, Utkarsh Sinha, Peter Hedman, Jonathan T. Barron, Sofien Bouaziz, Dan B Goldman, Ricardo Martin-Brualla, Steven M. Seitz
CVPR 2021, 24 Jun 2021
[arXiv] [Project] [Github]
CodeNeRF: Disentangled Neural Radiance Fields for Object Categories
Wonbong Jang, Lourdes Agapito
ICCV 2021, 3 Sep 2021
[arXiv] [Project] [Github]
Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation
Abhijit Kundu, Kyle Genova, Xiaoqi Yin, Alireza Fathi, Caroline Pantofaru, Leonidas Guibas, Andrea Tagliasacchi, Frank Dellaert, Thomas Funkhouser
CVPR 2022, 9 May 2022
[arXiv] [Project]
D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Video
Tianhao Wu, Fangcheng Zhong, Andrea Tagliasacchi, Forrester Cole, Cengiz Oztireli
CVPR 2022, 31 May 2022
[arXiv] [Project] [Github]
🔥Deforming Radiance Fields with Cages
Tianhan Xu, Tatsuya Harada
ECCV 2022, 25 Jul 2022
[arXiv] [Project] [Github]
🔥NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields
Liangchen Song, Anpei Chen, Zhong Li, Zhang Chen, Lele Chen, Junsong Yuan, Yi Xu, Andreas Geiger
IEEE TVCG, 28 Oct 2022
[arXiv] [Project] [Github(in nerfstudio)]
Robust Dynamic Radiance Fields
Yu-Lun Liu, Chen Gao, Andreas Meuleman, Hung-Yu Tseng, Ayush Saraf, Changil Kim, Yung-Yu Chuang, Johannes Kopf, Jia-Bin Huang
CVPR 2023, 5 Jan 2023
[arXiv] [Project]
🔥HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling
Benjamin Attal, Jia-Bin Huang, Christian Richardt, Michael Zollhoefer, Johannes Kopf, Matthew O'Toole, Changil Kim
arXiv preprint, 5 Jan 2023
[arXiv] [Project] [Github]
CageNeRF: Cage-based Neural Radiance Field for Generalized 3D Deformation and Animation
Yicong Peng, Yichao Yan, Shengqi Liu, Yuhao Cheng, Shanyan Guan, Bowen Pan, Guangtao Zhai, Xiaokang Yang
NeurIPS 2022, 01 Nov 2022
[OpenReview] [Zhihu] [Github]
DynIBaR: Neural Dynamic Image-Based Rendering
Zhengqi Li, Qianqian Wang, Forrester Cole, Richard Tucker, Noah Snavely
CVPR 2023, 20 Nov 2022
[arXiv] [Project] [Github] [Video]
MonoNeRF: Learning a Generalizable Dynamic Radiance Field from Monocular Videos
Fengrui Tian, Shaoyi Du, Yueqi Duan
ICCV 2023, 26 Dec 2022
[arXiv] [Github]
Robust Dynamic Radiance Fields
Yu-Lun Liu, Chen Gao, Andreas Meuleman, Hung-Yu Tseng, Ayush Saraf, Changil Kim, Yung-Yu Chuang, Johannes Kopf, Jia-Bin Huang
CVPR 2023, 5 Jan 2023
[arXiv] [Project] [Video]
🔥HexPlane: A Fast Representation for Dynamic Scenes
Ang Cao, Justin Johnson
CVPR 2023, 23 Jan 2023
[arXiv] [Project] [Github]
🔥K-Planes: Explicit Radiance Fields in Space, Time, and Appearance
Sara Fridovich-Keil, Giacomo Meanti, Frederik Warburg, Benjamin Recht, Angjoo Kanazawa
CVPR 2023, 24 Jan 2023
[arXiv] [Project] [Github] [Notes]
PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification
Xuan Li, Yi-Ling Qiao, Peter Yichen Chen, Krishna Murthy Jatavallabhula, Ming Lin, Chenfanfu Jiang, Chuang Gan
ICLR 2023, 02 Feb 2023
[OpenReview] [Project] [Github]
Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fields
Sungheon Park, Minjung Son, Seokhwan Jang, Young Chun Ahn, Ji-Yeon Kim, Nahyup Kang
CVPR 2023, 18 Feb 2023
[arXiv] [Project] [Video]
OD-NeRF: Efficient Training of On-the-Fly Dynamic Neural Radiance Fields
Zhiwen Yan, Chen Li, Gim Hee Lee
arXiv preprint, 24 May 2023
[arXiv]
SceNeRFlow: Time-Consistent Reconstruction of General Dynamic Scenes
Authors: Edith Tretschk, Vladislav Golyanik, Michael Zollhoefer, Aljaz Bozic, Christoph Lassner, Christian Theobalt
arXiv preprint, 16 August, 2023
[arXiv] [Project] [Video]
ResFields: Residual Neural Fields for Spatiotemporal Signals
Marko Mihajlovic, Sergey Prokudin, Marc Pollefeys, Siyu Tang
arXiv preprint, 6 Sep 2023
[arXiv] [Project] [Github]
Dynamic Mesh-Aware Radiance Fields
Yi-Ling Qiao, Alexander Gao, Yiran Xu, Yue Feng, Jia-Bin Huang, Ming C. Lin
ICCV 2023, 8 Sep 2023
[arXiv] [Project] [Github]
DynaMoN: Motion-Aware Fast And Robust Camera Localization for Dynamic NeRF
Mert Asim Karaoglu, Hannah Schieber, Nicolas Schischka, Melih Görgülü, Florian Grötzner, Alexander Ladikos, Daniel Roth, Nassir Navab, Benjamin Busam
arXiv preprint, 16 Sep 2023
[arXiv]
Point-DynRF: Point-based Dynamic Radiance Fields from a Monocular Video
Byeongjun Park, Changick Kim
WACV 2024, 14 Oct 2023
[arXiv]
Sync-NeRF: Generalizing Dynamic NeRFs to Unsynchronized Videos
Seoha Kim, Jeongmin Bae, Youngsik Yun, Hahyun Lee, Gun Bang, Youngjung Uh
arXiv preprint, 20 Oct 2023
[arXiv] [Project]
🔥Neural Sparse Voxel Fields
Lingjie Liu, Jiatao Gu, Kyaw Zaw Lin, Tat-Seng Chua, Christian Theobalt
NeurIPS 2020, 22 Jul 2020
[arXiv]
🔥NeRF++: Analyzing and Improving Neural Radiance Fields
Kai Zhang, Gernot Riegler, Noah Snavely, Vladlen Koltun
arXiv Preprint 2020, 15 Oct 2020
[arXiv] [Github]
DeRF: Decomposed Radiance Fields
Daniel Rebain, Wei Jiang, Soroosh Yazdani, Ke Li, Kwang Moo Yi, Andrea Tagliasacchi
CVPR 2021, 25 Nov 2020
[arXiv] [Project] [Github]
🔥AutoInt: Automatic Integration for Fast Neural Volume Rendering
David B. Lindell, Julien N. P. Martel, Gordon Wetzstein
CVPR 2021, 15 Oct 2020
[arXiv] [Github]
DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks
Thomas Neff, Pascal Stadlbauer, Mathias Parger, Andreas Kurz, Joerg H. Mueller, Chakravarty R. Alla Chaitanya, Anton Kaplanyan, Markus Steinberger
EGSR 2021, 4 Mar 2021
[arXiv] [Project] [Github]
FastNeRF: High-Fidelity Neural Rendering at 200FPS
Stephan J. Garbin, Marek Kowalski, Matthew Johnson, Jamie Shotton, Julien Valentin
ICCV 2021, 18 Mar 2021
[arXiv] [Project]
KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs
Christian Reiser, Songyou Peng, Yiyi Liao, Andreas Geiger
ICCV 2021, 25 Mar 2021
[arXiv] [Github]
🔥PlenOctrees for Real-time Rendering of Neural Radiance Fields
Alex Yu, Ruilong Li, Matthew Tancik, Hao Li, Ren Ng, Angjoo Kanazawa
ICCV 2021, 25 Mar 2021
[arXiv] [Project] [Github] [Viewer Github]
🔥Baking Neural Radiance Fields for Real-Time View Synthesis
Peter Hedman, Pratul P. Srinivasan, Ben Mildenhall, Jonathan T. Barron, Paul Debevec
ICCV 2021, 26 Mar 2021
[arXiv] [Project] [Github]
Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction
Cheng Sun, Min Sun, Hwann-Tzong Chen
CVPR 2022, 22 Nov 2021
[arXiv] [Project] [Github]
VaxNeRF: Revisiting the Classic for Voxel-Accelerated Neural Radiance Field
Naruya Kondo, Yuya Ikeda, Andrea Tagliasacchi, Yutaka Matsuo, Yoichi Ochiai, Shixiang Shane Gu
arXiv preprint, 25 Nov 2021
[arXiv] [Github]
NeuSample: Neural Sample Field for Efficient View Synthesis
Naruya Kondo, Yuya Ikeda, Andrea Tagliasacchi, Yutaka Matsuo, Yoichi Ochiai, Shixiang Shane Gu
arXiv preprint, 30 Nov 2021
[arXiv] [Project] [Github]
🔥Plenoxels: Radiance Fields without Neural Networks
Alex Yu, Sara Fridovich-Keil, Matthew Tancik, Qinhong Chen, Benjamin Recht, Angjoo Kanazawa
arXiv preprint, 30 Nov 2021
[arXiv] [Project] [Github]
🔥Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
Thomas Müller, Alex Evans, Christoph Schied, Alexander Keller
SIGGRAPH 2022, 16 Jan 2022
[arXiv] [Project] [Github]
🔥TensoRF: Tensorial Radiance Fields
Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, Hao Su
ECCV 2022, 17 Mar 2022
[arXiv] [Project] [Github] [Notes]
SqueezeNeRF: Further factorized FastNeRF for memory-efficient inference
Krishna Wadhwani, Tamaki Kojima
arXiv preprint, 6 Apr 2022
[arXiv]
AdaNeRF: Adaptive Sampling for Real-Time Rendering of Neural Radiance Fields
Andreas Kurz, Thomas Neff, Zhaoyang Lv, Michael Zollhöfer, Markus Steinberger
ECCV 2022, 21 Jul 2022
[arXiv] [Project] [Github]
🔥MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architectures
Zhiqin Chen, Thomas Funkhouser, Peter Hedman, Andrea Tagliasacchi
CVPR 2023, 30 Jul 2022
[arXiv] [Project] [Github]
Real-Time Neural Light Field on Mobile Devices
Junli Cao, Huan Wang, Pavlo Chemerys, Vladislav Shakhrai, Ju Hu, Yun Fu, Denys Makoviichuk, Sergey Tulyakov, Jian Ren
CVPR 2023, 15 Dec 2022
[arXiv] [Project] [Github]
Factor Fields: A Unified Framework for Neural Fields and Beyond
Anpei Chen, Zexiang Xu, Xinyue Wei, Siyu Tang, Hao Su, Andreas Geiger
arXiv preprint, 2 Feb 2023
[arXiv] [Project] [Github]
🔥MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes
Christian Reiser, Richard Szeliski, Dor Verbin, Pratul P. Srinivasan, Ben Mildenhall, Andreas Geiger, Jonathan T. Barron, Peter Hedman
arXiv preprint, 23 Feb 2023
[arXiv] [Project]
🔥BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis
Lior Yariv, Peter Hedman, Christian Reiser, Dor Verbin, Pratul P. Srinivasan, Richard Szeliski, Jonathan T. Barron, Ben Mildenhall
arXiv preprint, 28 Feb 2023
[arXiv] [Project]
Volume Feature Rendering for Fast Neural Radiance Field Reconstruction
Kang Han, Wei Xiang, Lu Yu
arXiv preprint, 29 May 2023
[arXiv]
Compact Real-time Radiance Fields with Neural Codebook
Lingzhi Li, Zhongshu Wang, Zhen Shen, Li Shen, Ping Tan
ICME 2023, 29 May 2023
[arXiv]
Dictionary Fields: Learning a Neural Basis Decomposition
Anpei Chen, Zexiang Xu, Xinyue Wei, Siyu Tang, Hao Su, Andreas Geiger
SIGGRAPH 2023
[Paper] [Github]
NAS-NeRF: Generative Neural Architecture Search for Neural Radiance Fields
NAS-NeRF: Generative Neural Architecture Search for Neural Radiance Fields
arXiv preprint, 25 Sep 2023
[arXiv] [Project]
Adaptive Multi-NeRF: Exploit Efficient Parallelism in Adaptive Multiple Scale Neural Radiance Field Rendering
Tong Wang, Shuichi Kurabayashi
arXiv preprint, 3 Oct 2023
[arXiv]
MIMO-NeRF: Fast Neural Rendering with Multi-input Multi-output Neural Radiance Fields
Takuhiro Kaneko
ICCV 2023, 3 Oct 2023
[arXiv] [Project]
Neural Processing of Tri-Plane Hybrid Neural Fields
Adriano Cardace, Pierluigi Zama Ramirez, Francesco Ballerini, Allan Zhou, Samuele Salti, Luigi Di Stefano
arXiv preprint, 2 Oct 2023
[arXiv]
CAwa-NeRF: Instant Learning of Compression-Aware NeRF Features
Omnia Mahmoud, Théo Ladune, Matthieu Gendrin
arXiv preprint, 23 Oct 2023
[arXiv]
Efficient Encoding of Graphics Primitives with Simplex-based Structures
Yibo Wen, Yunfan Yang
arXiv preprint, 26 Nov 2023
[arXiv]
🔥pixelNeRF: Neural Radiance Fields from One or Few Images
Alex Yu, Vickie Ye, Matthew Tancik, Angjoo Kanazawa
CVPR 2021, 3 Dec 2020
[arXiv] [Project] [Github]
IBRNet: Learning Multi-View Image-Based Rendering
Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul Srinivasan, Howard Zhou, Jonathan T. Barron, Ricardo Martin-Brualla, Noah Snavely, Thomas Funkhouser
CVPR 2021, 25 Feb 2021
[arXiv] [Project] [Github]
🔥Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis
Ajay Jain, Matthew Tancik, Pieter Abbeel
arXiv preprint, 1 Apr 2021
[arXiv] [Project] [Github]
MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis
Jiaxin Li, Zijian Feng, Qi She, Henghui Ding, Changhu Wang, Gim Hee Lee
ICCV 2021, 27 Mar 2021
[arXiv] [Project] [Github]
🔥MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo
Anpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang, Fanbo Xiang, Jingyi Yu, Hao Su
ICCV 2021, 29 Mar 2021
[arXiv] [Project] [Github]
Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstruction
Jeremy Reizenstein, Roman Shapovalov, Philipp Henzler, Luca Sbordone, Patrick Labatut, David Novotny
ICCV 2021, 29 Mar 2021
[arXiv] [Co3D Dataset]
RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs
Michael Niemeyer, Jonathan T. Barron, Ben Mildenhall, Mehdi S. M. Sajjadi, Andreas Geiger, Noha Radwan
CVPR 2022, 1 Dec 2021
[arXiv] [Project] [Code] [Notes]
🔥ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformers
Jonáš Kulhánek, Erik Derner, Torsten Sattler, Robert Babuška
ECCV 2022, 18 Mar 2022
[arXiv] [Project] [Github]
S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single Viewpoint
Wenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen, Kwan-Yee K. Wong
NeurIPS 2022, 17 Oct 2022
[arXiv] [Project] [Github]
NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views
Wenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen, Kwan-Yee K. Wong
arXiv preprint, 29 Nov 2022
[arXiv] [Project] [Github]
SPARF: Large-Scale Learning of 3D Sparse Radiance Fields from Few Input Images
Abdullah Hamdi, Bernard Ghanem, Matthias Nießner
arXiv preprint, 18 Dec 2022
[arXiv] [Project] [Github]
Geometry-biased Transformers for Novel View Synthesis
Naveen Venkat, Mayank Agarwal, Maneesh Singh, Shubham Tulsiani
arXiv preprint, 11 Jan 2023
[arXiv] [Project] [Github]
Behind the Scenes: Density Fields for Single View Reconstruction
Felix Wimbauer, Nan Yang, Christian Rupprecht, Daniel Cremers
CVPR 2023, 18 Jan 2023
[arXiv] [Project] [Github] [Video]
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion
Jiatao Gu, Alex Trevithick, Kai-En Lin, Josh Susskind, Christian Theobalt, Lingjie Liu, Ravi Ramamoorthi
arXiv preprint, 20 Feb 2023
[arXiv] [Project]
DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Models
Jamie Wynn, Daniyar Turmukhambetov
arXiv preprint, 23 Feb 2023
[arXiv] [Github]
🔥FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularization
Jiawei Yang, Marco Pavone, Yue Wang
CVPR 2023, 13 Mar 2023
[arXiv] [Project] [Github] [Notes]
Zero-1-to-3: Zero-shot One Image to 3D Object
Jiawei Yang, Marco Pavone, Yue Wang
CVPR 2023, 20 Mar 2023
[arXiv] [Project] [Github]
SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesis
Guangcong Wang, Zhaoxi Chen, Chen Change Loy, Ziwei Liu
ICCV 2023, 28 Mar 2023
[arXiv] [Project] [Github]
VGOS: Voxel Grid Optimization for View Synthesis from Sparse Inputs
Jiakai Sun, Zhanjie Zhang, Jiafu Chen, Guangyuan Li, Boyan Ji, Lei Zhao, Wei Xing
IJCAI 2023, 26 Apr 2023
[arXiv] [Github]
ViP-NeRF: Visibility Prior for Sparse Input Neural Radiance Fields
Nagabhushan Somraj, Rajiv Soundararajan
SIGGRAPH 2023, 28 Apr 2023
[arXiv] [Project] [Github] [Video]
DäRF: Boosting Radiance Fields from Sparse Inputs with Monocular Depth Adaptation
Jiuhn Song, Seonghoon Park, Honggyu An, Seokju Cho, Min-Seop Kwak, Sungjin Cho, Seungryong Kim
arXiv preprint, 30 May 2023
[arXiv] [Project]
ZIGNeRF: Zero-shot 3D Scene Representation with Invertible Generative Neural Radiance Fields
Kanghyeok Ko, Minhyeok Lee
arXiv preprint, 5 Jun 2023
[arXiv]
Car-Studio: Learning Car Radiance Fields from Single-View and Endless In-the-wild Images
Tianyu Liu, Hao Zhao, Yang Yu, Guyue Zhou, Ming Liu
IEEE RA-L, 26 Jul, 2023
[arXiv] [Project]
Where and How: Mitigating Confusion in Neural Radiance Fields from Sparse Inputs
Yanqi Bao, Yuxin Li, Jing Huo, Tianyu Ding, Xinyue Liang, Wenbin Li, Yang Gao
ACMMM 2023, 5 Aug 2023
[arXiv] [Github]
Novel-view Synthesis and Pose Estimation for Hand-Object Interaction from Sparse Views
Wentian Qu, Zhaopeng Cui, Yinda Zhang, Chenyu Meng, Cuixia Ma, Xiaoming Deng, Hongan Wang
arXiv preprint, 22 Aug 2023
[arXiv] [Project]
PERF: Panoramic Neural Radiance Field from a Single Panorama
Guangcong Wang, Peng Wang, Zhaoxi Chen, Wenping Wang, Chen Change Loy, Ziwei Liu
arXir preprint, 25 Oct 2023
[arXiv] [Project] [Github]
ManifoldNeRF: View-dependent Image Feature Supervision for Few-shot Neural Radiance Fields
Daiju Kanaoka, Motoharu Sonogashira, Hakaru Tamukoh, Yasutomo Kawanishi
BMVC2023, 20 Oct 2023
[arXiv] [Github]
How Many Views Are Needed to Reconstruct an Unknown Object Using NeRF?
Sicong Pan, Liren Jin, Hao Hu, Marija Popović, Maren Bennewitz
ICRA 2024, 1 Oct 2023
[arXiv]
CaesarNeRF: Calibrated Semantic Representation for Few-shot Generalizable Neural Rendering
Haidong Zhu, Tianyu Ding, Tianyi Chen, Ilya Zharkov, Ram Nevatia, Luming Liang
arXiv preprint, 27 Nov 2023
[arXiv] [Project]
iMAP: Implicit Mapping and Positioning in Real-Time
Edgar Sucar, Shikun Liu, Joseph Ortiz, Andrew J. Davison
ICCV 2021, 23 Mar 2021
[arXiv] [Project]
🔥NICE-SLAM: Neural Implicit Scalable Encoding for SLAM
Zihan Zhu, Songyou Peng, Viktor Larsson, Weiwei Xu, Hujun Bao, Zhaopeng Cui, Martin R. Oswald, Marc Pollefeys
CVPR 2022, 22 Dec 2021
[arXiv] [Project] [Github] [Notes]
Towards Open World NeRF-Based SLAM
Daniil Lisus, Connor Holmes, Steven Waslander
CRV 2023, 8 Jan 2023
[arXiv]
INeRF: Inverting Neural Radiance Fields for Pose Estimation
Lin Yen-Chen, Pete Florence, Jonathan T. Barron, Alberto Rodriguez, Phillip Isola, Tsung-Yi Lin
IROS 2021, 10 Dec 2020
[arXiv] [Github]
🔥NeRF--: Neural Radiance Fields Without Known Camera Parameters
Zirui Wang, Shangzhe Wu, Weidi Xie, Min Chen, Victor Adrian Prisacariu
arXiv preprint, 14 Feb 2021
[arXiv] [Project] [Github]
GNeRF: GAN-based Neural Radiance Field without Posed Camera
Quan Meng, Anpei Chen, Haimin Luo, Minye Wu, Hao Su, Lan Xu, Xuming He, Jingyi Yu
ICCV 2021, 29 Mar 2021
[arXiv] [Github]
🔥BARF: Bundle-Adjusting Neural Radiance Fields
Chen-Hsuan Lin, Wei-Chiu Ma, Antonio Torralba, Simon Lucey
ICCV 2021, 13 Apr 2021
[arXiv] [Project] [Github]
Self-Calibrating Neural Radiance Fields
Yoonwoo Jeong, Seokjun Ahn, Christopher Choy, Animashree Anandkumar, Minsu Cho, Jaesik Park
ICCV 2021, 13 Apr 2021
[arXiv] [Project] [Github]
Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields
Yue Chen, Xingyu Chen, Xuan Wang, Qi Zhang, Yu Guo, Ying Shan, Fei Wang
CVPR 2023, 21 Nov 2022
[arXiv] [Project] [Github]
🔥NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior
Wenjing Bian, Zirui Wang, Kejie Li, Jia-Wang Bian, Victor Adrian Prisacariu
CVPR 2023, 14 Dec 2022
[arXiv] [Project] [Github]
F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories
Peng Wang, Yuan Liu, Zhaoxi Chen, Lingjie Liu, Ziwei Liu, Taku Komura, Christian Theobalt, Wenping Wang
CVPR 2023, 28 Mar 2023
[arXiv] [Project] [Github]
Neural Lens Modeling
Wenqi Xian, Aljaž Božič, Noah Snavely, Christoph Lassner
CVPR 2023, 10 Apr 2023
[arXiv] [Project]
H2-Mapping: Real-time Dense Mapping Using Hierarchical Hybrid Representation
Chenxing Jiang, Hanwen Zhang, Peize Liu, Zehuan Yu, Hui Cheng, Boyu Zhou, Shaojie Shen
IEEE Robotics and Automation Letters, 5 Jun 2023
[arXiv] [Github] [Video]
LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFs
Zezhou Cheng, Carlos Esteves, Varun Jampani, Abhishek Kar, Subhransu Maji, Ameesh Makadia
arXiv preprint, 8 Jun 2023
[arXiv] [Project]
CamP: Camera Preconditioning for Neural Radiance Fields
Keunhong Park, Philipp Henzler, Ben Mildenhall, Jonathan T. Barron, Ricardo Martin-Brualla
Siggraph Asia 2023, 21 Aug, 2023
[arXiv] [Project]
MC-NeRF: Muti-Camera Neural Radiance Fields for Muti-Camera Image Acquisition Systems
Yu Gao, Lutong Su, Hao Liang, Yufeng Yue, Yi Yang, Mengyin Fu
arXiv preprint, 14 Sep 2023
[arXiv] [Github]
BID-NeRF: RGB-D image pose estimation with inverted Neural Radiance Fields
Ágoston István Csehi, Csaba Máté Józsa
Nerf4ADR of ICCV 2023, 5 Oct 2023
[arXiv]
NeRFtrinsic Four: An End-To-End Trainable NeRF Jointly Optimizing Diverse Intrinsic and Extrinsic Camera Parameters
Hannah Schieber, Fabian Deuser, Bernhard Egger, Norbert Oswald, Daniel Roth
arXiv preprint, 26 Oct 2023
[arXiv]
PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction
Jia-Wang Bian, Wenjing Bian, Victor Adrian Prisacariu, Philip Torr
arXiv preprint, 11 Oct 2023
[arXiv]
CBARF: Cascaded Bundle-Adjusting Neural Radiance Fields from Imperfect Camera Poses
Hongyu Fu, Xin Yu, Lincheng Li, Li Zhang
arXiv preprint, 15 Oct 2023
[arXiv]
Continuous Pose for Monocular Cameras in Neural Implicit Representation
Qi Ma, Danda Pani Paudel, Ajad Chhatkuli, Luc Van Gool
arXiv preprint, 28 Nov 2023
[arXiv]
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era
Chenghao Li, Chaoning Zhang, Atish Waghwase, Lik-Hang Lee, Francois Rameau, Yang Yang, Sung-Ho Bae, Choong Seon Hong
arXiv prepring, 10 May 2023
[arXiv]
Zero-Shot Text-Guided Object Generation with Dream Fields
Ajay Jain, Ben Mildenhall, Jonathan T. Barron, Pieter Abbeel, Ben Poole
CVPR 2022, 2 Dec 2021
[arXiv] [Project] [Github]
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields
Can Wang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
CVPR 2022, 9 Dec 2021
[arXiv] [Project] [Github]
LaTeRF: Label and Text Driven Object Radiance Fields
Ashkan Mirzaei, Yash Kant, Jonathan Kelly, Igor Gilitschenski
CVPR 2022, 4 Jul 2022
[arXiv] [Project]
DreamFusion: Text-to-3D using 2D Diffusion
Ben Poole, Ajay Jain, Jonathan T. Barron, Ben Mildenhall
arXiv preprint, 29 Sep 2022
[arXiv] [Project] [Unofficial Impl] [threeStudio] [Notes]
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures
Gal Metzer, Elad Richardson, Or Patashnik, Raja Giryes, Daniel Cohen-Or
arXiv preprint, 14 Nov 2022
[arXiv] [Github] [threeStudio]
🔥Magic3D: High-Resolution Text-to-3D Content Creation
Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, Tsung-Yi Lin
CVPR 2023, 18 Nov 2022
[arXiv] [Project] [threeStudio] [Notes]
Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation
Haochen Wang, Xiaodan Du, Jiahao Li, Raymond A. Yeh, Greg Shakhnarovich
CVPR 2023, 1 Dec 2022
[arXiv] [Project] [Github] [threeStudio]
SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction
Zhizhuo Zhou, Shubham Tulsiani
CVPR 2023, 1 Dec 2022
[arXiv] [Project] [Github]
🔥Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models
Jiale Xu, Xintao Wang, Weihao Cheng, Yan-Pei Cao, Ying Shan, Xiaohu Qie, Shenghua Gao
CVPR 2023, 28 Dec 2022
[arXiv] [Project]
Text-To-4D Dynamic Scene Generation
Jiale Xu, Xintao Wang, Weihao Cheng, Yan-Pei Cao, Ying Shan, Xiaohu Qie, Shenghua Gao
arXiv preprint, 26 Jan 2023
[arXiv] [Project]
🔥LERF: Language Embedded Radiance Fields
Justin Kerr, Chung Min Kim, Ken Goldberg, Angjoo Kanazawa, Matthew Tancik
arXiv preprint, 16 Mar 2023
[arXiv] [Project] [Github]
🔥Shap-E: Generating Conditional 3D Implicit Functions
Heewoo Jun, Alex Nichol
arXiv preprint, 3 May 2023
[arXiv] [Github]
🔥DreamBooth3D: Subject-Driven Text-to-3D Generation
Amit Raj, Srinivas Kaza, Ben Poole, Michael Niemeyer, Nataniel Ruiz, Ben Mildenhall, Shiran Zada, Kfir Aberman, Michael Rubinstein, Jonathan Barron, Yuanzhen Li, Varun Jampani
arXiv preprint, 23 Mar 2023
[arXiv] [Project]
Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation
Rui Chen, Yongwei Chen, Ningxin Jiao, Kui Jia
arXiv preprint, 24 Mar 2023
[arXiv] [Project] [Github] [threeStudio]
DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model
Hoigi Seo, Hayeon Kim, Gwanghyun Kim, Se Young Chun
CVPR 2023, 6 Apr 2023
[arXiv] [Project] [Github]
🔥ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, Jun Zhu
arXiv preprint, 25 May 2023
[arXiv] [Project] [Unofficial Implementation]
ATT3D: Amortized Text-to-3D Object Synthesis
Jonathan Lorraine, Kevin Xie, Xiaohui Zeng, Chen-Hsuan Lin, Towaki Takikawa,Nicholas Sharp, Tsung-Yi Lin, Ming-Yu Liu, Sanja Fidler, James Lucas
nVidia release
[Project]
One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization
Minghua Liu, Chao Xu, Haian Jin, Linghao Chen, Mukund Varma T, Zexiang Xu, Hao Su
arXiv preprint, 29 Jun 2023
[arXiv] [Project] [Github]
Points-to-3D: Bridging the Gap between Sparse Points and Shape-Controllable Text-to-3D Generation
Chaohui Yu, Qiang Zhou, Jingliang Li, Zhe Zhang, Zhibin Wang, Fan Wang
ACMMM 2023, 26 Jul, 2023
[arXiv]
HD-Fusion: Detailed Text-to-3D Generation Leveraging Multiple Noise Estimation
Jinbo Wu, Xiaobo Gao, Xing Liu, Zhengyang Shen, Chen Zhao, Haocheng Feng, Jingtuo Liu, Errui Ding
arXiv preprint, 30 Jul 2023
[arXiv]
AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Pose
Huichao Zhang, Bowen Chen, Hao Yang, Liao Qu, Xu Wang, Li Chen, Chao Long, Feida Zhu, Kang Du, Min Zheng
arXiv preprint, 7 Aug 2023
[arXiv] [Project]
Animate124: Animating One Image to 4D Dynamic Scene
Yuyang Zhao, Zhiwen Yan, Enze Xie, Lanqing Hong, Zhenguo Li, Gim Hee Lee
arXiv preprint, 24 Nov 2023
[arXiv] [Project]
DiffRF: Rendering-Guided 3D Radiance Field Diffusion
Ashkan Mirzaei, Yash Kant, Jonathan Kelly, Igor Gilitschenski
CVPR 2023, 2 Dec 2022
[arXiv] [Project]
🔥3DGen: Triplane Latent Diffusion for Textured Mesh Generation
Anchit Gupta, Wenhan Xiong, Yixin Nie, Ian Jones, Barlas Oğuz
arXiv preprint, 9 Mar 2023
[arXiv]
🔥MeshDiffusion: Score-based Generative 3D Mesh Modeling
Zhen Liu, Yao Feng, Michael J. Black, Derek Nowrouzezahrai, Liam Paull, Weiyang Liu
ICLR 2023, 14 Mar 2023
[arXiv] [Project] [Github]
Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction
Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, Hao Su
arXiv preprint, 13 Apr 2023
[arXiv] [Project] [Github]
🔥Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior
Junshu Tang, Tengfei Wang, Bo Zhang, Ting Zhang, Ran Yi, Lizhuang Ma, Dong Chen
arXiv preprint, 23 Mar 2023
[arXiv] [Project] [Github] [Notes]
Deceptive-NeRF: Enhancing NeRF Reconstruction using Pseudo-Observations from Diffusion Models
Xinhang Liu, Shiu-hong Kao, Jiaben Chen, Yu-Wing Tai, Chi-Keung Tang
arXiv preprint, 24 May 2023
[arXiv]
Local Implicit Ray Function for Generalizable Radiance Field Representation
Xin Huang, Qi Zhang, Ying Feng, Xiaoyu Li, Xuan Wang, Qing Wang
CVPR 2023, 25 Apr 2023
[arXiv] [Project] [Video]
HollowNeRF: Pruning Hashgrid-Based NeRFs with Trainable Collision Mitigation
Xiufeng Xie, Riccardo Gherardi, Zhihong Pan, Stephen Huang
ICCV 2023, 19 Aug 2023
[arXiv]
GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields
Michael Niemeyer, Andreas Geiger
CVPR 2012, 24 Nov 2020
[arXiv] [Project] [Github]
Neural Point-Based Graphics
Kara-Ali Aliev, Artem Sevastopolsky, Maria Kolos, Dmitry Ulyanov, Victor Lempitsky
arXiv preprint, 19 Jun 2019
[arXiv] [Github] [Video]
Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance
Lior Yariv, Yoni Kasten, Dror Moran, Meirav Galun, Matan Atzmon, Ronen Basri, Yaron Lipman
NeurIPS 2020, 22 Mar 2020
[arXiv] [Project] [Github]
Neural RGB-D Surface Reconstruction
Dejan Azinović, Ricardo Martin-Brualla, Dan B Goldman, Matthias Nießner, Justus Thies
CVPR 2022, 9 Apr 2021
[arXiv] [Project] [Github]
🔥NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, Wenping Wang
NeurIPS 2021, 20 Jun 2021
[arXiv] [Project] [Github]
Volume Rendering of Neural Implicit Surfaces
Lior Yariv, Jiatao Gu, Yoni Kasten, Yaron Lipman
NeurIPS 2021, 22 Jun 2021
[arXiv] [Project] [Github]
HF-NeuS: Improved Surface Reconstruction Using High-Frequency Details
Yiqun Wang, Ivan Skorokhodov, Peter Wonka
NeurIPS 2022, 15 Jun 2022
[arXiv] [Github] [Notes]
NPBG++: Accelerating Neural Point-Based Graphics
Ruslan Rakhimov, Andrei-Timotei Ardelean, Victor Lempitsky, Evgeny Burnaev
CVPR 2022, 24 Mar 2022
[arXiv] [Project] [Github]
NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstruction
Yiming Wang, Qin Han, Marc Habermann, Kostas Daniilidis, Christian Theobalt, Lingjie Liu
ICCV 2023, 10 Dec 2022
[arXiv] [Project] [Github]
PET-NeuS: Positional Encoding Tri-Planes for Neural Surfaces
Yiqun Wang, Ivan Skorokhodov, Peter Wonka
CVPR 2023, 9 May 2023
[arXiv] [Github]
NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Support
Xinyue Wei, Fanbo Xiang, Sai Bi, Anpei Chen, Kalyan Sunkavalli, Zexiang Xu, Hao Su
arXiv preprint, 26 May 2023
[arXiv] [Project]
NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors
Jiepeng Wang, Peng Wang, Xiaoxiao Long, Christian Theobalt, Taku Komura, Lingjie Liu, Wenping Wang
arXiv preprint, 27 Jun 2022
[arXiv] [Project] [Github]
EventNeRF: Neural Radiance Fields from a Single Colour Event Camera
Viktor Rudnev, Mohamed Elgharib, Christian Theobalt, Vladislav Golyanik
CVPR 2023, 23 Jun 2022
[arXiv] [Project] [Github]
Instant-3D: Instant Neural Radiance Field Training Towards On-Device AR/VR 3D Reconstruction
Sixu Li, Chaojian Li, Wenbo Zhu, Boyang (Tony)Yu, Yang (Katie)Zhao, Cheng Wan, Haoran You, Huihong Shi, Yingyan (Celine)Lin
ISCA 2023, 24 Apr 2023
[arXiv]
Robust e-NeRF: NeRF from Sparse & Noisy Events under Non-Uniform Motion
Weng Fei Low, Gim Hee Lee
ICCV 2023, 15 Sep 2023
[arXiv] [Project] [Github]
Deformable Neural Radiance Fields using RGB and Event Cameras
Qi Ma, Danda Pani Paudel, Ajad Chhatkuli, Luc Van Gool
arXiv preprint, 25 Sep 2023
[arXiv]
USB-NeRF: Unrolling Shutter Bundle Adjusted Neural Radiance Fields
Moyang Li, Peng Wang, Lingzhe Zhao, Bangyan Liao, Peidong Liu
arXiv preprint, 4 Oct 2023
[arXiv]
🔥Point-NeRF: Point-based Neural Radiance Fields
Qiangeng Xu, Zexiang Xu, Julien Philip, Sai Bi, Zhixin Shu, Kalyan Sunkavalli, Ulrich Neumann
CVPR 2022, 21 Jan 2022
[arXiv] [Project] [Github]
Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedra
Qiangeng Xu, Zexiang Xu, Julien Philip, Sai Bi, Zhixin Shu, Kalyan Sunkavalli, Ulrich Neumann
arXiv preprint, 19 Apr 2023
[arXiv] [Project] [Github] [Notes]
Neural LiDAR Fields for Novel View Synthesis
Shengyu Huang, Zan Gojcic, Zian Wang, Francis Williams, Yoni Kasten, Sanja Fidler, Konrad Schindler, Or Litany
arXiv preprint, 2 May 2023
[arXiv] [Project] [Notes]
Point2Pix: Photo-Realistic Point Cloud Rendering via Neural Radiance Fields
Tao Hu, Xiaogang Xu, Shu Liu, Jiaya Jia
arXiv preprint, 29 Mar 2023
[arXiv] [Video]
AutoNeRF: Training Implicit Scene Representations with Autonomous Agents
Pierre Marza, Laetitia Matignon, Olivier Simonin, Dhruv Batra, Christian Wolf, Devendra Singh Chaplot
arXiv preprint, 21 Apr 2023
[arXiv] [Project] [Video]
NerfBridge: Bringing Real-time, Online Neural Radiance Field Training to Robotics
Javier Yu, Jun En Low, Keiko Nagami, Mac Schwager
ICRA 2023, 16 May 2023
[arXiv] [Github] [Video]
🔥AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Yudong Guo, Keyu Chen, Sen Liang, Yong-Jin Liu, Hujun Bao, Juyong Zhang
ICCV 2021, 20 Mar 2021
[arXiv] [Project] [Github]
MoFaNeRF: Morphable Facial Neural Radiance Field
Yiyu Zhuang, Hao Zhu, Xusen Sun, Xun Cao
ECCV 2022, 4 Dec 2021
[arXiv] [Project] [Github] [Video]
AutoAvatar: Autoregressive Neural Fields for Dynamic Avatar Modeling
Ziqian Bai, Timur Bagautdinov, Javier Romero, Michael Zollhöfer, Ping Tan, Shunsuke Saito
ECCV 2022, 25 Mar 2022
[arXiv] [Project] [Github] [Video]
UV Volumes for Real-time Rendering of Editable Free-view Human Performance
Yue Chen, Xuan Wang, Xingyu Chen, Qi Zhang, Xiaoyu Li, Yu Guo, Jue Wang, Fei Wang
CVPR 2023, 27 Mar 2022
[arXiv] [Project] [Github]
Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis
Shuai Shen, Wanhua Li, Zheng Zhu, Yueqi Duan, Jie Zhou, Jiwen Lu
ECCV 2022, 24 Jul 2022
[arXiv] [Project] [Github] [Video]
EVA3D: Compositional 3D Human Generation from 2D Image Collections
Fangzhou Hong, Zhaoxi Chen, Yushi Lan, Liang Pan, Ziwei Liu
ICLR 2023, 10 Oct 2022
[arXiv] [Project] [Github] [Video]
🔥Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion
Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, Baining Guo
arXiv preprint, 12 Dec 2022
[arXiv] [Project] [Video]
InstantAvatar: Learning Avatars from Monocular Video in 60 Seconds
Tianjian Jiang, Xu Chen, Jie Song, Otmar Hilliges
arXiv preprint, 20 Dec 2022
[arXiv] [Project] [Github] [Video]
PersonNeRF: Personalized Reconstruction from Photo Collections
Chung-Yi Weng, Pratul P. Srinivasan, Brian Curless, Ira Kemelmacher-Shlizerman
arXiv preprint, 16 Feb 2023
[arXiv] [Project] [Video]
Learning Neural Volumetric Representations of Dynamic Humans in Minutes
Chen Geng, Sida Peng, Zhen Xu, Hujun Bao, Xiaowei Zhou
CVPR 2023, 23 Feb 2023
[arXiv] [Project] [Video]
NeuFace: Realistic 3D Neural Face Rendering from Multi-view Images
Mingwu Zheng, Haiyu Zhang, Hongyu Yang, Di Huang
CVPR 2023, 24 Mar 2023
[arXiv] [Github] [Notes]
🔥HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motion
Mustafa Işık, Martin Rünz, Markos Georgopoulos, Taras Khakhulin, Jonathan Starck, Lourdes Agapito, Matthias Nießner
SIGGRAPH 2023, 10 May 2023
[arXiv] [Project] [Github] [Video] [Notes]
BlendFields: Few-Shot Example-Driven Facial Modeling
Kacper Kania, Stephan J. Garbin, Andrea Tagliasacchi, Virginia Estellers, Kwang Moo Yi, Julien Valentin, Tomasz Trzciński, Marek Kowalski
arXiv preprint, 12 May 2023
[arXiv] [Project] [Video]
Neural Face Rigging for Animating and Retargeting Facial Meshes in the Wild
Dafei Qin, Jun Saito, Noam Aigerman, Thibault Groueix, Taku Komura
arXiv preprint, 15 May 2023
[arXiv]
NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objects
Taeksoo Kim, Shunsuke Saito, Hanbyul Joo
arXiv preprint, 23 May 2023
[arXiv] [Project]
FDNeRF: Semantics-Driven Face Reconstruction, Prompt Editing and Relighting with Diffusion Models
Hao Zhang, Yanbo Xu, Tianyuan Dai, Yu-Wing, Tai Chi-Keung Tang
arXiv preprint, 1 Jun 2023
[arXiv] [Github]
PixelHuman: Animatable Neural Radiance Fields from Few Images
Gyumin Shim, Jaeseong Lee, Junha Hyung, Jaegul Choo
arXiv preprint, 18 Jul 2023
[arXiv]
Efficient Region-Aware Neural Radiance Fields for High-Fidelity Talking Portrait Synthesis
Jiahe Li, Jiawei Zhang, Xiao Bai, Jun Zhou, Lin Gu
ICCV 2023, 18 Jul 2023
[arXiv] [Github]
FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields
Sungwon Hwang, Junha Hyung, Daejin Kim, Min-Jung Kim, Jaegul Choo
ICCV 2023, 21 July, 2023
[arXiv]
TransHuman: A Transformer-based Human Representation for Generalizable Neural Human Rendering
Xiao Pan, Zongxin Yang, Jianxin Ma, Chang Zhou, Yi Yang
ICCV 2023, 23 Jul 2023
[arXiv] [Project]
HAvatar: High-fidelity Head Avatar via Facial Model Conditioned Neural Radiance Field
Xiaochen Zhao, Lizhen Wang, Jingxiang Sun, Hongwen Zhang, Jinli Suo, Yebin Liu
arXiv preprint, 29 Sep 2023
[arXiv]
Point-Based Radiance Fields for Controllable Human Motion Synthesis
Haitao Yu, Deheng Zhang, Peiyuan Xie, Tianyi Zhang
arXiv preprint, 5 Oct 2023
[arXiv]
DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing
Jia-Wei Liu, Yan-Pei Cao, Jay Zhangjie Wu, Weijia Mao, Yuchao Gu, Rui Zhao, Jussi Keppo, Ying Shan, Mike Zheng Shou
arXiv preprint, 16 Oct 2023
[arXiv] [Project]
CosAvatar: Consistent and Animatable Portrait Video Tuning with Text Prompt
Haiyao Xiao, Chenglai Zhong, Xuan Gao, Yudong Guo, Juyong Zhang
arXiv preprint, 30 Nov 2023
[arXiv] [Project]
🔥NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images
Ben Mildenhall, Peter Hedman, Ricardo Martin-Brualla, Pratul Srinivasan, Jonathan T. Barron
CVPR 2022, 26 Nov 2021
[arXiv] [Project] [Github]
Deblur-NeRF: Neural Radiance Fields from Blurry Images
Li Ma, Xiaoyu Li, Jing Liao, Qi Zhang, Xuan Wang, Jue Wang, Pedro V. Sander
CVPR 2022, 29 Nov 2021
[arXiv] [Project] [Github]
HDR-NeRF: High Dynamic Range Neural Radiance Fields
Xin Huang, Qi Zhang, Ying Feng, Hongdong Li, Xuan Wang, Qing Wang
CVPR 2022, 29 Nov 2021
[arXiv] [Project] [Github]
NeRF-SR: High-Quality Neural Radiance Fields using Supersampling
Chen Wang, Xian Wu, Yuan-Chen Guo, Song-Hai Zhang, Yu-Wing Tai, Shi-Min Hu
MM 2022, 3 Dec 2021
[arXiv] [Project] [Github]
Aleth-NeRF: Low-light Condition View Synthesis with Concealing Fields
Ziteng Cui, Lin Gu, Xiao Sun, Yu Qiao, Tatsuya Harada
arXiv preprint, 10 Mar 2023
[arXiv] [Project] [Github]
Lighting up NeRF via Unsupervised Decomposition and Enhancement
*Haoyuan Wang, Xiaogang Xu, Ke Xu, Rynson WH. Lau
ICCV 2023, 20 Jul 2023
[arXiv] [Project] [Github]
🔥Urban Radiance Fields
Konstantinos Rematas, Andrew Liu, Pratul P. Srinivasan, Jonathan T. Barron, Andrea Tagliasacchi, Thomas Funkhouser, Vittorio Ferrari
CVPR 2022, 29 Nov 2021
[arXiv] [Project]
Hallucinated Neural Radiance Fields in the Wild
Xingyu Chen, Qi Zhang, Xiaoyu Li, Yue Chen, Ying Feng, Xuan Wang, Jue Wang
CVPR 2022, 30 Nov 2021
[arXiv] [Project] [Github]
NeRF for Outdoor Scene Relighting
Viktor Rudnev, Mohamed Elgharib, William Smith, Lingjie Liu, Vladislav Golyanik, Christian Theobalt
ECCV 2022, 9 Dec 2021
[arXiv] [Project] [Github]
BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering
Viktor Rudnev, Mohamed Elgharib, William Smith, Lingjie Liu, Vladislav Golyanik, Christian Theobalt
ECCV 2022, 10 Dec 2021
[arXiv] [Project] [Github]
🔥Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs
Haithem Turki, Deva Ramanan, Mahadev Satyanarayanan
CVPR 2022, 20 Dec 2021
[arXiv] [Project] [Github]
🔥Block-NeRF: Scalable Large Scene Neural View Synthesis
Matthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Pradhan, Ben Mildenhall, Pratul P. Srinivasan, Jonathan T. Barron, Henrik Kretzschmar
CVPR 2022, 10 Feb 2022
[arXiv] [Project]
READ: Large-Scale Neural Scene Rendering for Autonomous Driving
Zhuopeng Li, Lu Li, Zeyu Ma, Ping Zhang, Junbo Chen, Jianke Zhu
AAAI 2023, 11 May 2022
[arXiv] [Github] [Video]
DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis
Yinghao Xu, Menglei Chai, Zifan Shi, Sida Peng, Ivan Skorokhodov, Aliaksandr Siarohin, Ceyuan Yang, Yujun Shen, Hsin-Ying Lee, Bolei Zhou, Sergey Tulyakov
arXiv preprint, 22 Dec 2022
[arXiv] [Prject] [Github] [Video]
S-NeRF: Neural Radiance Fields for Street Views
Ziyang Xie, Junge Zhang, Wenye Li, Feihu Zhang, Li Zhang
ICLR 2023, 1 Mar 2023
[arXiv] [Prject] [Video]
Progressively Optimized Local Radiance Fields for Robust View Synthesis
Andreas Meuleman, Yu-Lun Liu, Chen Gao, Jia-Bin Huang, Changil Kim, Min H. Kim, Johannes Kopf
CVPR 2023, 24 Mar 2023
[arXiv] [Prject] [Video]
SUDS: Scalable Urban Dynamic Scenes
Haithem Turki, Jason Y. Zhang, Francesco Ferroni, Deva Ramanan
CVPR 2023, 25 Mar 2023
[arXiv] [Prject] [Github] [Video]
Neural Fields meet Explicit Geometric Representations for Inverse Rendering of Urban Scenes
Zian Wang, Tianchang Shen, Jun Gao, Shengyu Huang, Jacob Munkberg, Jon Hasselgren, Zan Gojcic, Wenzheng Chen, Sanja Fidler
CVPR 2023, 6 Apr 2023
[arXiv] [Prject] [Video]
NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models
Seung Wook Kim, Bradley Brown, Kangxue Yin, Karsten Kreis, Katja Schwarz, Daiqing Li, Robin Rombach, Antonio Torralba, Sanja Fidler
CVPR 2023, 19 Apr 2023
[arXiv] [Prject] [Video]
PlaNeRF: SVD Unsupervised 3D Plane Regularization for NeRF Large-Scale Scene Reconstruction
Fusang Wang, Arnaud Louys, Nathan Piasco, Moussab Bennehar, Luis Roldão, Dzmitry Tsishkou
arXiv preprint, 26 May 2023
[arXiv]
Urban Radiance Field Representation with Deformable Neural Mesh Primitives
Fan Lu, Yan Xu, Guang Chen, Hongsheng Li, Kwan-Yee Lin, Changjun Jiang
ICCV 2023, 20 Jul 2023
[arXiv] [Project] [Github]
Federated Learning for Large-Scale Scene Modeling with Neural Radiance Fields
Teppei Suzuki
arXiv preprint, 12 Sep 2023
[arXiv]
UE4-NeRF:Neural Radiance Field for Real-Time Rendering of Large-Scale Scene
Jiaming Gu, Minchao Jiang, Hongsheng Li, Xiaoyuan Lu, Guangming Zhu, Syed Afaq Ali Shah, Liang Zhang, Mohammed Bennamoun
NeurIPS 2023, 20 Oct 2023
[arXiv] [Project] [Github]
PanopticNeRF-360: Panoramic 3D-to-2D Label Transfer in Urban Scenes
Xiao Fu, Shangzhan Zhang, Tianrun Chen, Yichong Lu, Xiaowei Zhou, Andreas Geiger, Yiyi Liao
arXiv preprint, 19 Sep 2023
[arXiv] [Project] [Github]
MMPI: a Flexible Radiance Field Representation by Multiple Multi-plane Images Blending
Yuze He, Peng Wang, Yubin Hu, Wang Zhao, Ran Yi, Yong-Jin Liu, Wenping Wang
arXiv preprint, 30 Sep 2023
[arXiv]
PC-NeRF: Parent-Child Neural Radiance Fields under Partial Sensor Data Loss in Autonomous Driving Environments
Xiuzhong Hu, Guangming Xiong, Zheng Zang, Peng Jia, Yuxuan Han, Junyi Ma
arXiv preprint, 2 Oct 2023
[arXiv] [Github]
UC-NeRF: Neural Radiance Field for Under-Calibrated multi-view cameras in autonomous driving
Kai Cheng, Xiaoxiao Long, Wei Yin, Jin Wang, Zhiqiang Wu, Yuexin Ma, Kaixuan Wang, Xiaozhi Chen, Xuejin Chen
arXiv preprint, 28 Nov 2023
[arXiv] [Project]
DGNR: Density-Guided Neural Point Rendering of Large Driving Scenes
Zhuopeng Li, Chenming Wu, Liangjun Zhang, Jianke Zhu
arXiv preprint, 28 Nov 2023
[arXiv]
SCALAR-NeRF: SCAlable LARge-scale Neural Radiance Fields for Scene Reconstruction
Yu Chen, Gim Hee Lee
arXiv preprint, 28 Nov 2023
[arXiv] [Project]
EvE: Exploiting Generative Priors for Radiance Field Enrichment
Karim Kassab, Antoine Schnepf, Jean-Yves Franceschi, Laurent Caraffa, Jeremie Mary, Valérie Gouet-Brunet
arXiv preprint, 1 Dec 2023
[arXiv] [Project]
Recolorable Posterization of Volumetric Radiance Fields Using Visibility-Weighted Palette Extraction
Seung Wook Kim, Bradley Brown, Kangxue Yin, Karsten Kreis, Katja Schwarz, Daiqing Li, Robin Rombach, Antonio Torralba, Sanja Fidler
CVPR 2023, 19 Apr 2022
[Paper] [Project] [Github]
ClimateNeRF: Physically-based Neural Rendering for Extreme Climate Synthesis
Yuan Li, Zhi-Hao Lin, David Forsyth, Jia-Bin Huang, Shenlong Wang
CVPR 2023, 19 Apr 2022
[arXiv] [Project] [Video]
NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editing
Bangbang Yang, Chong Bao, Junyi Zeng, Hujun Bao, Yinda Zhang, Zhaopeng Cui, Guofeng Zhang
CVPR 2022, 25 Jul 2022
[arXiv] [Project] [Github]
🔥SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fields
Ashkan Mirzaei, Tristan Aumentado-Armstrong, Konstantinos G. Derpanis, Jonathan Kelly, Marcus A. Brubaker, Igor Gilitschenski, Alex Levinshtein
CVPR 2023, 22 Nov 2022
[arXiv] [Project] [Github] [Video] [Notes]
NeRF-Art: Text-Driven Neural Radiance Fields Stylization
Can Wang, Ruixiang Jiang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
arXiv preprint, 15 Dec 2022
[arXiv] [Project] [Github] [Video]
PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields
Zhengfei Kuang, Fujun Luan, Sai Bi, Zhixin Shu, Gordon Wetzstein, Kalyan Sunkavalli
arXiv preprint, 21 Dec 2022
[arXiv] [Project] [Github] [Video]
RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenes
Bingchen Gong, Yuehao Wang, Xiaoguang Han, Qi Dou
arXiv preprint, 19 Jan 2023
[arXiv] [Project] [Github] [Video]
🔥Interactive Geometry Editing of Neural Radiance Fields
Shaoxu Li, Ye Pan
I3D 2023, 21 Mar 2023
[arXiv] [Project] [Github] [Video] [Notes]
🔥Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions
Ayaan Haque, Matthew Tancik, Alexei A. Efros, Aleksander Holynski, Angjoo Kanazawa
arXiv preprint, 22 Mar 2023
[arXiv] [Project] [Github] [Video]
SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field
Chong Bao, Yinda Zhang, Bangbang Yang, Tianxing Fan, Zesong Yang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui
CVPR 2023, 23 Mar 2023
[arXiv] [Project] [Video]
PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervision
Konstantinos Tertikas, Despoina Paschalidou, Boxiao Pan, Jeong Joon Park, Mikaela Angelina Uy, Ioannis Emiris, Yannis Avrithis, Leonidas Guibas
CVPR 2023, 16 Mar 2023
[arXiv] [Project] [Github]
InpaintNeRF360: Text-Guided 3D Inpainting on Unbounded Neural Radiance Fields
Dongqing Wang, Tong Zhang, Alaa Abboud, Sabine Süsstrunk
arXiv preprint, 24 May 2023
[arXiv]
FusedRF: Fusing Multiple Radiance Fields
Rahul Goel, Dhawal Sirikonda, Rajvi Shah, PJ Narayanan
CVPR Workshop, 7 Jun 2023
[arXiv]
RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models
Xingchen Zhou, Ying He, F. Richard Yu, Jianqiang Li, You Li
IJCAI 2023, 9 Jun 2023
[arXiv] [Github]
Relighting Neural Radiance Fields With Shadow and Highlight Hints
Chong Zeng, Guojun Chen, Yue Dong, Pieter Peers, Hongzhi Wu, Xin Tong
SIGGRAPH 2023
[Paper] [Project] [Github]
Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fields
Shangzhan Zhang, Sida Peng, Yinji ShenTu, Qing Shuai, Tianrun Chen, Kaicheng Yu, Hujun Bao, Xiaowei Zhou
arXiv preprint, 24 Jul 2023
[arXiv] [Project]
Seal-3D: Interactive Pixel-Level Editing for Neural Radiance Fields
Xiangyu Wang, Jingsen Zhu, Qi Ye, Yuchi Huo, Yunlong Ran, Zhihua Zhong, Jiming Chen
ICCV 2023, 27 Jul 2023
[arXiv] [Project] [Github]
Mirror-NeRF: Learning Neural Radiance Fields for Mirrors with Whitted-Style Ray Tracing
Junyi Zeng, Chong Bao, Rui Chen, Zilong Dong, Guofeng Zhang, Hujun Bao, Zhaopeng Cui
ACMMM 2023, 7 Aug 2023
[arXiv] [Project]
Learning Unified Decompositional and Compositional NeRF for Editable Novel View Synthesis
Yuxin Wang, Wayne Wu, Dan Xu
ICCV 2023, 5 Aug 2023
[arXiv] [Project]
DeformToon3D: Deformable 3D Toonification from Neural Radiance Fields
Junzhe Zhang, Yushi Lan, Shuai Yang, Fangzhou Hong, Quan Wang, Chai Kiat Yeo, Ziwei Liu, Chen Change Loy
ICCV 2023, 8 Sep 2023
[arXiv] [Project] [Github]
Locally Stylized Neural Radiance Fields
Hong-Wing Pang, Binh-Son Hua, Sai-Kit Yeung
ICCV 2023, 19 Sep 2023
[arXiv]
Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates
Ka Chun Shum, Jaeyeon Kim, Binh-Son Hua, Duc Thanh Nguyen, Sai-Kit Yeung
arXiv preprint, 20 Sep 2023
[arXiv]
MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Field
Zijiang Yang, Zhongwei Qiu, Chang Xu, Dongmei Fu
arXiv preprint, 24 Sep 2023
[arXiv]
ED-NeRF: Efficient Text-Guided Editing of 3D Scene using Latent Space NeRF
Jangho Park, Gihyun Kwon, Jong Chul Ye
arXiv preprint, 4 Oct 2023
[arXiv]
Neural Impostor: Editing Neural Radiance Fields with Explicit Shape Manipulation
Ruiyang Liu, Jinxu Xiang, Bowen Zhao, Ran Zhang, Jingyi Yu, Changxi Zheng
Pacific Graphics 2023, 9 Oct 2023
[arXiv]
A Real-time Method for Inserting Virtual Objects into Neural Radiance Fields
Keyang Ye, Hongzhi Wu, Xin Tong, Kun Zhou
arXiv preprint, 9 Oct, 2023
[arXiv]
TraM-NeRF: Tracing Mirror and Near-Perfect Specular Reflections through Neural Radiance Fields
Leif Van Holland, Ruben Bliersbach, Jan U. Müller, Patrick Stotko, Reinhard Klein
arXiv preprint, 16 Oct 2023
[arXiv]
Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training
Runze He, Shaofei Huang, Xuecheng Nie, Tianrui Hui, Luoqi Liu, Jiao Dai, Jizhong Han, Guanbin Li, Si Liu
arXiv preprint, 4 Dec 2023
[arXiv] [Project]
NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies
Xiaoxiao Long, Cheng Lin, Lingjie Liu, Yuan Liu, Peng Wang, Christian Theobalt, Taku Komura, Wenping Wang
CVPR 2023, 25 Nov 2022
[arXiv] [Project] [Github] [Video]
NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images
Xiaoxu Meng, Weikai Chen, Bo Yang
CVPR 2023, 21 Mar 2023
[arXiv] [Project] [Github] [Video]
NeuralClothSim: Neural Deformation Fields Meet the Kirchhoff-Love Thin Shell Theory
Navami Kairanda, Marc Habermann, Christian Theobalt, Vladislav Golyanik
arXiv preprint, 24 Aug 2023
[arXiv] [Project] [Video]
SSDNeRF: Semantic Soft Decomposition of Neural Radiance Fields
Siddhant Ranade, Christoph Lassner, Kai Li, Christian Haene, Shen-Chi Chen, Jean-Charles Bazin, Sofien Bouaziz
arXiv preprint, 7 Dec 2022
[arXiv] [Project] [Video]
🔥Panoptic Lifting for 3D Scene Understanding with Neural Fields
Yawar Siddiqui, Lorenzo Porzi, Samuel Rota Buló, Norman Müller, Matthias Nießner, Angela Dai, Peter Kontschieder
CVPR 2023, 19 Dec 2022
[arXiv] [Project] [Github] [Video]
Segment Anything in 3D with NeRFs
Jiazhong Cen, Zanwei Zhou, Jiemin Fang, Wei Shen, Lingxi Xie, Dongsheng Jiang, Xiaopeng Zhang, Qi Tian
arXiv preprint, 24 Apr 2023
[arXiv] [Project] [Github] [Video]
Obj-NeRF: Extract Object NeRFs from Multi-view Images
Zhiyi Li, Lihe Ding, Tianfan Xue
arXiv preprint, 26 Nov, 2023
[arXiv]
SANeRF-HQ: Segment Anything for NeRF in High Quality
Yichen Liu, Benran Hu, Chi-Keung Tang, Yu-Wing Tai
arXiv preprint, 3 Dec 2023
[arXiv] [Project]
🔥Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement
Jiaxiang Tang, Hang Zhou, Xiaokang Chen, Tianshu Hu, Errui Ding, Jingdong Wang, Gang Zeng
arXiv preprint, 3 Mar 2023
[arXiv/] [Project] [Github] [Video]
Learning Neural Volumetric Field for Point Cloud Geometry Compression
Yueyu Hu, Yao Wang
PCS 2022, 11 Dec 2022
[arXiv] [Project] [Github]
Towards Scalable Neural Representation for Diverse Videos
Bo He, Xitong Yang, Hanyu Wang, Zuxuan Wu, Hao Chen, Shuaiyi Huang, Yixuan Ren, Ser-Nam Lim, Abhinav Shrivastava
CVPR 2023, 24 Mar 2023
[arXiv] [Project] [Github]
🔥Neural Residual Radiance Fields for Streamably Free-Viewpoint Videos
Liao Wang, Qiang Hu, Qihan He, Ziyu Wang, Jingyi Yu, Tinne Tuytelaars, Lan Xu, Minye Wu
CVPR 2023, 11 Dec 2022
[arXiv] [Project]
VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams
Liao Wang, Kaixin Yao, Chengcheng Guo, Zhirui Zhang, Qiang Hu, Jingyi Yu, Lan Xu, Minye Wu
arxiv preprint, 3 Dec 2023
[arXiv] [Project]
One is All: Bridging the Gap Between Neural Radiance Fields Architectures with Progressive Volume Distillation
Shuangkang Fang, Weixin Xu, Heng Wang, Yi Yang, Yufeng Wang, Shuchang Zhou
AAAI 2023, 29 Nov 2022
[arXiv] [Project] [Github] [PVD-AL Github]
MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray
Abril Corona-Figueroa, Jonathan Frawley, Sam Bond-Taylor, Sarath Bethapudi, Hubert P. H. Shum, Chris G. Willcocks
EMBC 2022, 2 Feb 2022
[arXiv] [Github]
NeAT: Neural Adaptive Tomography
Darius Rückert, Yuanhao Wang, Rui Li, Ramzi Idoughi, Wolfgang Heidrich
arXiv preprint, 4 Feb, 2022
[arXiv]
NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstruction
Ruyi Zha, Yanhao Zhang, Hongdong Li
MICCAI 2022, 29 Sep 2022
[arXiv]
SNAF: Sparse-view CBCT Reconstruction with Neural Attenuation Fields
Yu Fang, Lanzhuju Mei, Changjian Li, Yuan Liu, Wenping Wang, Zhiming Cui, Dinggang Shen
arXiv preprint, 30 Nov 2022
[arXiv]
Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction
Yiqun Lin, Zhongjin Luo, Wei Zhao, Xiaomeng Li
arXiv preprint, 12 Mar 2023
[arXiv]
Geometry-Aware Attenuation Field Learning for Sparse-View CBCT Reconstruction
Zhentao Liu, Yu Fang, Changjian Li, Han Wu, Yuan Liu, Zhiming Cui, Dinggang Shen
arXiv preprint, 26 Mar, 2023
[arXiv]
ColonNeRF: Neural Radiance Fields for High-Fidelity Long-Sequence Colonoscopy Reconstruction
Yufei Shi, Beijia Lu, Jia-Wei Liu, Ming Li, Mike Zheng Shou
arXiv preprint, 4 Dec 2023
[arXiv] [Project]
🔥Multi-view Inverse Rendering for Large-scale Real-world Indoor Scenes
Zhen Li, Lingli Wang, Mofang Cheng, Cihui Pan, Jiaqi Yang
CVPR 2023, 18 Nov 2022
[arXiv] [Project] [Github] [Video]
🔥TensoIR: Tensorial Inverse Rendering
Haian Jin, Isabella Liu, Peijia Xu, Xiaoshuai Zhang, Songfang Han, Sai Bi, Xiaowei Zhou, Zexiang Xu, Hao Su
CVPR 2023, 24 Apr 2023
[arXiv] [Project] [Github] [Video]
🔥Inverse Global Illumination using a Neural Radiometric Prior
Saeed Hadadan, Geng Lin, Jan Novák, Fabrice Rousselle, Matthias Zwicker
SIGGRAPH 2023, 3 May 2023
[arXiv] [Notes]
SplitNeRF: Split Sum Approximation Neural Field for Joint Geometry, Illumination, and Material Estimation
Jesus Zarzar, Bernard Ghanem
arXiv preprint, 28 Nov 2023
[arXiv]
NeRF-Tex: Neural Reflectance Field Textures
Hendrik Baatz, Jonathan Granskog, Marios Papas, Fabrice Rousselle, Jan Novák
EGSR 2021, 22 Jun, 2021
[Paper] [Project]
NeRF-Texture: Texture Synthesis With Neural Radiance Fields
Yihua Huang, Yan-Pei Cao, Yu-Kun Lai, Ying Shan, Lin Gao
SIGGRAPH 2023
[Video]
NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fields
Xiaoxue Chen, Junchen Liu, Hao Zhao, Guyue Zhou, Ya-Qin Zhang
arXiv preprint, 22 Sep 2023
[arXiv]
🔥Patch-based 3D Natural Scene Generation from a Single Example
Weiyu Li, Xuelin Chen, Jue Wang, Baoquan Chen
CVPR 2023, 25 Apr 2023
[arXiv] [Project] [Github] [Notes]
ORCa: Glossy Objects as Radiance Field Cameras
Kushagra Tiwary, Akshat Dave, Nikhil Behari, Tzofi Klinghoffer, Ashok Veeraraghavan, Ramesh Raskar
arXiv preprint, 8 Dec 2022
[arXiv] [Projects] [Video]
WaterNeRF: Neural Radiance Fields for Underwater Scenes
Advaith Venkatramanan Sethuraman, Manikandasriram Srinivasan Ramanagopal, Katherine A. Skinner
arXiv preprint, 27 Sep 2022
[arXiv]
Towards a Robust Framework for NeRF Evaluation
Adrian Azzarelli, Nantheera Anantrasirichai, David R Bull
arXiv preprint, 29 May 2023
[arXiv]
Magic NeRF Lens: Interactive Fusion of Neural Radiance Fields for Virtual Facility Inspection
Ke Li, Susanne Schmidt, Tim Rolff, Reinhard Bacher, Wim Leemans, Frank Steinicke
TCVG, 19 Jul 2023
[arXiv]
Improving NeRF with Height Data for Utilization of GIS Data
Hinata Aoki, Takao Yamanaka
ICIP 2023, 15 Jul 2023
[arXiv]
Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Cameras
Roger Marí, Gabriele Facciolo, Thibaud Ehret
CVPR 2022, 16 Mar 2022
[arXiv]
SparseSat-NeRF: Dense Depth Supervised Neural Radiance Fields for Sparse Satellite Images
Lulin Zhang, Ewelina Rupnik
ISPRS Annals 2023, 1 Sep 2023
[arXiv] [Github]
Enabling Neural Radiance Fields (NeRF) for Large-scale Aerial Images -- A Multi-tiling Approaching and the Geometry Assessment of NeRF
Ningli Xu, Rongjun Qin, Debao Huang, Fabio Remondino
arXiv preprint, 1 Oct 2023
[arXiv]
CopyRNeRF: Protecting the CopyRight of Neural Radiance Fields
Ziyuan Luo, Qing Guo, Ka Chun Cheung, Simon See, Renjie Wan
ICCV 2023, 21 Jul 2023
[arXiv] [Project]
Steganography for Neural Radiance Fields by Backdooring
Weina Dong, Jia Liu, Yan Ke, Lifeng Chen, Wenquan Sun, Xiaozhong Pan
arXiv preprint, 19 Sep 2023
[arXiv]
Targeted Adversarial Attacks on Generalizable Neural Radiance Fields
Andras Horvath, Csaba M. Jozsa
*arXiv preprint, 5 Oct 2023
[arXiv]
3D Motion Magnification: Visualizing Subtle Motions with Time Varying Radiance Fields
Brandon Y. Feng, Hadi Alzayer, Michael Rubinstein, William T. Freeman, Jia-Bin Huang
ICCV 2023, 7 Aug 2023
[arXiv] [Project]
MVImgNet: A Large-scale Dataset of Multi-view Images
Xianggang Yu, Mutian Xu, Yidan Zhang, Haolin Liu, Chongjie Ye, Yushuang Wu, Zizheng Yan, Chenming Zhu, Zhangyang Xiong, Tianyou Liang, Guanying Chen, Shuguang Cui, Xiaoguang Han
CVPR 2023, 10 Mar 2023
[arXiv] [Project] [Github] [Notes]
DiVA-360: The Dynamic Visuo-Audio Dataset for Immersive Neural Fields
Cheng-You Lu, Peisen Zhou, Angela Xing, Chandradeep Pokhariya, Arnab Dey, Ishaan Shah, Rugved Mavidipalli, Dylan Hu, Andrew Comport, Kefan Chen, Srinath Sridhar
arXiv preprint, 31 Jul 2023
[arXiv] [Project]
Neural Kernel Surface Reconstruction
Jiahui Huang, Zan Gojcic, Matan Atzmon, Or Litany, Sanja Fidler, Francis Williams
CVPR 2023, 31 May 2023
[arXiv]
Neuralangelo: High-Fidelity Neural Surface Reconstruction
Zhaoshuo Li, Thomas Müller, Alex Evans, Russell H. Taylor, Mathias Unberath, Ming-Yu Liu, Chen-Hsuan Lin
CVPR 2023, 5 Jun 2023
[arXiv] [Project] [Video]
Thanks to the community and hoping more and more people are joining us and submit commits and PRs!
Made with contributors-img.
CC-0