awesome gan-inversion
This repo is a collection of resources on GAN inversion, as a supplement for our survey.
survey
GAN Inversion: A Survey.
Weihao Xia, Yulun Zhang, Yujiu Yang, Jing-Hao Xue, Bolei Zhou, Ming-Hsuan Yang.
arxiv 2021. [PDF]
citation
@article{xia2021survey,
author = {Xia, Weihao and Zhang, Yulun and Yang, Yujiu and Xue, Jing-Hao and Zhou, Bolei and Yang, Ming-Hsuan},
title = {GAN Inversion: A Survey},
journal = {arXiv preprint arXiv: 2101.05278},
year={2021}
}
inverted pretrained model
StyleGAN3: Alias-Free Generative Adversarial Networks.
Tero Karras, Miika Aittala, Samuli Laine, Erik Härkönen, Janne Hellsten, Jaakko Lehtinen, Timo Aila.
NeurIPS 2021. [PDF] [Project] [Github] [Rosinality]
StyleGAN2-Ada: Training Generative Adversarial Networks with Limited Data.
Tero Karras, Miika Aittala, Janne Hellsten, Samuli Laine, Jaakko Lehtinen, Timo Aila.
NeurIPS 2020. [PDF] [Github] [Steam StyleGAN2-ADA]
StyleGAN2: Analyzing and Improving the Image Quality of StyleGAN.
Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, Timo Aila.
CVPR 2020. [PDF] [PyTorch] [Offical TF] [Unoffical Tensorflow 2.0]
StyleGAN: A Style-Based Generator Architecture for Generative Adversarial Networks.
Tero Karras, Samuli Laine, Timo Aila.
CVPR 2019. [PDF] [Offical TF]
ProGAN: Progressive Growing of GANs for Improved Quality, Stability, and Variation.
Tero Karras, Timo Aila, Samuli Laine, Jaakko Lehtinen.
ICLR 2018. [PDF] [Offical TF]
inversion method
This part contatins generatal inversion methods, while methods in the next application part are mainly designed for specific tasks.
StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGAN.
Min Jin Chong, Hsin-Ying Lee, David Forsyth.
arxiv 2021. [PDF] [Github]
StyleAlign: Analysis and Applications of Aligned StyleGAN Models.
Zongze Wu, Yotam Nitzan, Eli Shechtman, Dani Lischinski.
arxiv 2021. [PDF]
Real Image Inversion via Segments.
David Futschik, Michal Lukáč, Eli Shechtman, Daniel Sýkora.
arxiv 2021. [PDF]
High-Fidelity GAN Inversion for Image Attribute Editing.
Tengfei Wang, Yong Zhang, Yanbo Fan, Jue Wang, Qifeng Chen.
arxiv 2021. [PDF] [Project] [Github]
StyleVideoGAN: A Temporal Generative Model using a Pretrained StyleGAN.
Gereon Fox, Ayush Tewari, Mohamed Elgharib, Christian Theobalt.
arxiv 2021. [PDF]
Semantic and Geometric Unfolding of StyleGAN Latent Space.
Mustafa Shukor, Xu Yao, Bharath Bhushan Damodaran, Pierre Hellier.
arxiv 2021. [PDF]
Pivotal Tuning for Latent-based Editing of Real Images.
Daniel Roich, Ron Mokady, Amit H. Bermano, Daniel Cohen-Or.
arxiv 2021. [PDF] [Github]
Transforming the Latent Space of StyleGAN for Real Face Editing.
Heyi Li, Jinlong Liu, Yunzhi Bai, Huayan Wang, Klaus Mueller.
arxiv 2021. [PDF] [Github]
A Simple Baseline for StyleGAN Inversion.
Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao, Weiming Zhang, Lu Yuan, Gang Hua, Nenghai Yu.
arxiv 2021. [PDF] [Github] [Project]
LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions.
Oğuz Kaan Yüksel, Enis Simsar, Ezgi Gülperi Er, Pinar Yanardag.
arxiv 2021. [PDF] [Github]
GAN-Control: Explicitly Controllable GANs.
Alon Shoshan, Nadav Bhonker, Igor Kviatkovsky, Gerard Medioni.
arxiv 2021. [PDF]
Improved StyleGAN Embedding: Where are the Good Latents?
Peihao Zhu, Rameen Abdal, Yipeng Qin, Peter Wonka.
arxiv 2020. [PDF]
Learning a Deep Reinforcement Learning Policy Over the Latent Space of a Pre-trained GAN for Semantic Age Manipulation.
Kumar Shubham, Gopalakrishnan Venkatesh, Reijul Sachdev, Akshi, Dinesh Babu Jayagopi, G. Srinivasaraghavan.
arxiv 2020. [PDF]
Lifting 2D StyleGAN for 3D-Aware Face Generation.
Yichun Shi, Divyansh Aggarwal, Anil K. Jain.
arxiv 2020. [PDF]
Augmentation-Interpolative AutoEncoders for Unsupervised Few-Shot Image Generation.
Davis Wertheimer, Omid Poursaeed, Bharath Hariharan.
arxiv 2020. [PDF]
Explaining in Style: Training a GAN to explain a classifier in StyleSpace.
Oran Lang, Yossi Gandelsman, Michal Yarom, Yoav Wald, Gal Elidan, Avinatan Hassidim, William T. Freeman, Phillip Isola, Amir Globerson, Michal Irani, Inbar Mosseri.
ICCV 2021. [PDF] [Project]
BDInvert: GAN Inversion for Out-of-Range Images with Geometric Transformations.
Kyoungkook Kang, Seongtae Kim, Sunghyun Cho.
ICCV 2021. [PDF] [Project]
From Continuity to Editability: Inverting GANs with Consecutive Images.
Yangyang Xu, Yong Du, Wenpeng Xiao, Xuemiao Xu and Shengfeng He.
ICCV 2021. [PDF] [Github]
ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinement.
Yuval Alaluf, Or Patashnik, Daniel Cohen-Or.
ICCV 2021. [PDF] [Project] [Github]
Disentangled Face Attribute Editing via Instance-Aware Latent Space Search.
Yuxuan Han, Jiaolong Yang, Ying Fu.
IJCAI 2021. [PDF] [Github]
Prior Image-Constrained Reconstruction using Style-Based Generative Models.
Varun A Kelkar, Mark Anastasio.
ICML 2021. [PDF]
Intermediate Layer Optimization for Inverse Problems using Deep Generative Models.
Giannis Daras, Joseph Dean, Ajil Jalal, Alexandros G. Dimakis.
ICML 2021. [PDF] [Github]
Using Latent Space Regression to Analyze and Leverage Compositionality in GANs.
Lucy Chai, Jonas Wulff, Phillip Isola.
ICLR 2021. [PDF] [Github] [Project] [Colab]
Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation.
Peiye Zhuang, Oluwasanmi Koyejo, Alexander G. Schwing.
ICLR 2021. [PDF]
Ensembling with Deep Generative Views.
Lucy Chai, Jun-Yan Zhu, Eli Shechtman, Phillip Isola, Richard Zhang.
CVPR 2021. [PDF] [Github] [Project]
Navigating the GAN Parameter Space for Semantic Image Editing.
Anton Cherepkov, Andrey Voynov, Artem Babenko.
CVPR 2021. [PDF] [Github]
StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation.
Zongze Wu, Dani Lischinski, Eli Shechtman.
CVPR 2021 (oral). [PDF] [Github]
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation.
Elad Richardson, Yuval Alaluf, Or Patashnik, Yotam Nitzan, Yaniv Azar, Stav Shapiro, Daniel Cohen-Or.
CVPR 2021. [PDF] [Github] [Project]
GHFeat: Generative Hierarchical Features from Synthesizing Images.
Yinghao Xu, Yujun Shen, Jiapeng Zhu, Ceyuan Yang, Bolei Zhou.
CVPR 2021. [PDF] [Github] [Project]
Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANs.
Hui-Po Wang, Ning Yu, Mario Fritz.
CVPR 2021. [PDF]
e4e: Designing an Encoder for StyleGAN Image Manipulation.
Omer Tov, Yuval Alaluf, Yotam Nitzan, Or Patashnik, Daniel Cohen-Or.
TOG 2021. [PDF] [Github]
StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows.
Rameen Abdal, Peihao Zhu, Niloy Mitra, Peter Wonka.
TOG 2021. [PDF] [Github]
Mask-Guided Discovery of Semantic Manifolds in Generative Models.
Mengyu Yang, David Rokeby, Xavier Snelgrove.
NeurIPS 2020 Workshop on Machine Learning for Creativity and Design. [PDF] [Github]
Unsupervised Discovery of Disentangled Manifolds in GANs.
Yu-Ding Lu, Hsin-Ying Lee, Hung-Yu Tseng, Ming-Hsuan Yang.
arxiv 2020. [PDF]]
On The Inversion Of Deep Generative Models (When and How Can Deep Generative Models be Inverted?).
Aviad Aberdam, Dror Simon, Michael Elad.
arxiv 2020. [PDF] [OpenReview]
Collaborative Learning for Faster StyleGAN Embedding.
Shanyan Guan, Ying Tai, Bingbing Ni, Feida Zhu, Feiyue Huang, Xiaokang Yang.
arxiv 2020. [PDF]
Disentangling in Latent Space by Harnessing a Pretrained Generator.
Yotam Nitzan, Amit Bermano, Yangyan Li, Daniel Cohen-Or.
arxiv 2020. [PDF]
Improving Inversion and Generation Diversity in StyleGAN using a Gaussianized Latent Space.
Jonas Wulff, Antonio Torralba.
arxiv 2020. [PDF]
PIE: Portrait Image Embedding for Semantic Control.
A. Tewari, M. Elgharib, M. BR, F. Bernard, H-P. Seidel, P. Pérez, M. Zollhöfer, C.Theobalt.
TOG 2020. [PDF] [Project]
Understanding the Role of Individual Units in a Deep Neural Network.
David Bau, Jun-Yan Zhu, Hendrik Strobelt, Agata Lapedriza, Bolei Zhou, Antonio Torralba.
National Academy of Sciences 2020. [PDF] [Github] [Project]
Face Identity Disentanglement via Latent Space Mapping.
Yotam Nitzan, Amit Bermano, Yangyan Li, Daniel Cohen-Or.
TOG 2020. [PDF] [Github]
Transforming and Projecting Images into Class-conditional Generative Networks.
Minyoung Huh, Richard Zhang, Jun-Yan Zhu, Sylvain Paris, Aaron Hertzmann.
ECCV 2020. [PDF] [Github] [Project]
MimicGAN: Robust Projection onto Image Manifolds with Corruption Mimicking.
Rushil Anirudh, Jayaraman J. Thiagarajan, Bhavya Kailkhura, Timo Bremer.
IJCV 2020. [PDF]
Rewriting a Deep Generative Model.
David Bau, Steven Liu, Tongzhou Wang, Jun-Yan Zhu, Antonio Torralba.
ECCV 2020. [PDF] [Github]
StyleGAN2 Distillation for Feed-forward Image Manipulation.
Yuri Viazovetskyi, Vladimir Ivashkin, Evgeny Kashin.
ECCV 2020. [PDF] [Github]
In-Domain GAN Inversion for Real Image Editing.
Jiapeng Zhu, Yujun Shen, Deli Zhao, Bolei Zhou.
ECCV 2020. [PDF] [Project] [Github]
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation.
Xingang Pan, Xiaohang Zhan, Bo Dai, Dahua Lin, Chen Change Loy, Ping Luo.
ECCV 2020. [PDF] [Github]
Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Models.
Giannis Daras, Augustus Odena, Han Zhang, Alexandros G. Dimakis.
CVPR 2020. [PDF]
A Disentangling Invertible Interpretation Network for Explaining Latent Representations.
Patrick Esser, Robin Rombach, Björn Ommer.
CVPR 2020. [PDF] [Project] [Github]
Editing in Style: Uncovering the Local Semantics of GANs.
Edo Collins, Raja Bala, Bob Price, Sabine Süsstrunk.
CVPR 2020. [PDF] [Github]
Image Processing Using Multi-Code GAN Prior.
Jinjin Gu, Yujun Shen, Bolei Zhou.
CVPR 2020. [PDF] [Project] [Github]
Image2StyleGAN++: How to Edit the Embedded Images?
Rameen Abdal, Yipeng Qin, Peter Wonka.
CVPR 2020. [PDF]
Semantic Photo Manipulation with a Generative Image Prior.
David Bau, Hendrik Strobelt, William Peebles, Jonas, Bolei Zhou, Jun-Yan Zhu, Antonio Torralba.
TOG 2019. [PDF]
Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?
Rameen Abdal, Yipeng Qin, Peter Wonka.
ICCV 2019. [PDF] [Github]
GAN-based Projector for Faster Recovery with Convergence Guarantees in Linear Inverse Problems.
Ankit Raj, Yuqi Li, Yoram Bresler.
ICCV 2019. [PDF]
Inverting Layers of a Large Generator.
David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, Antonio Torralba.
ICCV 2019. [PDF]
Detecting Overfitting in Deep Generators via Latent Recovery.
Ryan Webster, Julien Rabin, Loic Simon, Frederic Jurie.
CVPR 2019. [PDF][Colab]
Inverting The Generator Of A Generative Adversarial Network (II).
Antonia Creswell, Anil A Bharath.
TNNLS 2018. [PDF] [Github]
Invertibility of Convolutional Generative Networks from Partial Measurements.
Fangchang Ma, Ulas Ayaz, Sertac Karaman.
NeurIPS 2018. [PDF] [Github]
Metrics for Deep Generative Models.
Nutan Chen, Alexej Klushyn, Richard Kurle, Xueyan Jiang, Justin Bayer, Patrick van der Smagt.
AISTATS 2018. [PDF]
Towards Understanding the Invertibility of Convolutional Neural Networks.
Anna C. Gilbert, Yi Zhang, Kibok Lee, Yuting Zhang, Honglak Lee.
IJCAI 2017. [PDF]
One Network to Solve Them All - Solving Linear Inverse Problems using Deep Projection Models.
J. H. Rick Chang, Chun-Liang Li, Barnabas Poczos, B. V. K. Vijaya Kumar, Aswin C. Sankaranarayanan.
ICCV 2017. [PDF]
Precise Recovery of Latent Vectors from Generative Adversarial Networks.
Zachary C. Lipton, Subarna Tripathi.
ICLR 2017 workshop. [PDF] [Github]
Inverting The Generator Of A Generative Adversarial Network.
Antonia Creswell, Anil Anthony Bharath.
NeurIPS 2016 Workshop. [PDF]
Generative Visual Manipulation on the Natural Image Manifold.
Jun-Yan Zhu, Philipp Krähenbühl, Eli Shechtman, Alexei A. Efros.
ECCV 2016. [PDF]
latent space navigation
Inversion is not the ultimate goal. The reason that we invert a real image into the latent space of a trained GAN model is that we can manipulate the inverted image in the latent space by discovering the desired code with certain attributes. This technique is usually known as latent space navigation, GAN steerability, latent code manipulation, or other names in the literature. Although often regarded as an independent research field, it acts as an indispensable component of GAN inversion for manipulation. Many inversion methods also involve efficient discovery of a desired latent code.
LARGE: Latent-Based Regression through GAN Semantics.
Yotam Nitzan, Rinon Gal, Ofir Brenner, Daniel Cohen-Or.
arxiv 2021. [PDF] [Github] [Project]
StyleFusion: A Generative Model for Disentangling Spatial Segments.
Omer Kafri, Or Patashnik, Yuval Alaluf, Daniel Cohen-Or.
arxiv 2021. [PDF] [Github]
Do Not Escape From the Manifold: Discovering the Local Coordinates on the Latent Space of GANs.
Jaewoong Choi, Changyeon Yoon, Junho Lee, Jung Ho Park, Geonho Hwang, Myungjoo Kang.
arxiv 2021. [PDF]
Interpreting the Latent Space of GANs via Correlation Analysis for Controllable Concept Manipulation.
Ziqiang Li, Rentuo Tao, Hongjing Niu, Bin Li.
arxiv 2020. [PDF]
LowRankGAN: Low-Rank Subspaces in GANs.
Jiapeng Zhu, Ruili Feng, Yujun Shen, Deli Zhao, Zhengjun Zha, Jingren Zhou, Qifeng Chen.
NeurIPS 2021. [PDF] [Github]
Controllable and Compositional Generation with Latent-Space Energy-Based Models.
Weili Nie, Arash Vahdat, Anima Anandkumar.
NeurIPS 2021. [PDF]
A Latent Transformer for Disentangled and Identity-Preserving Face Editing.
Xu Yao, Alasdair Newson, Yann Gousseau, Pierre Hellier.
ICCV 2021. [PDF] [Github]
A Latent Transformer for Disentangled Face Editing in Images and Videos.
Xu Yao, Alasdair Newson, Yann Gousseau, Pierre Hellier.
ICCV 2021. [PDF] [ArXiV] [Github]
Toward a Visual Concept Vocabulary for GAN Latent Space.
Sarah Schwettmann, Evan Hernandez, David Bau, Samuel Klein, Jacob Andreas, Antonio Torralba.
ICCV 2021. [PDF] [Project]
WarpedGANSpace: Finding Non-linear RBF Paths in GAN Latent Space.
Christos Tzelepis, Georgios Tzimiropoulos, Ioannis Patras.
ICCV 2021. [PDF] [Github]
OroJaR: Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generation.
Yuxiang Wei, Yupeng Shi, Xiao Liu, Zhilong Ji, Yuan Gao, Zhongqin Wu, Wangmeng Zuo.
ICCV 2021. [PDF] [Github]
EigenGAN: Layer-Wise Eigen-Learning for GANs.
Zhenliang He, Meina Kan, Shiguang Shan.
ICCV 2021. [PDF] [Github]
SalS-GAN: Spatially-Adaptive Latent Space in StyleGAN for Real Image Embedding.
Lingyun Zhang, Xiuxiu Bai, Yao Gao.
ACM MM 2021. [PDF]
Discovering Density-Preserving Latent Space Walks in GANs for Semantic Image Transformations.
Guanyue Li, Yi Liu, Xiwen Wei, Yang Zhang, Si Wu, Yong Xu, Hau San Wong.
ACM MM 2021. [PDF]
Discovering Interpretable Latent Space Directions of GANs Beyond Binary Attributes.
Huiting Yang, Liangyu Chai, Qiang Wen, Shuang Zhao, Zixun Sun, Shengfeng He.
CVPR 2021. [PDF]
Surrogate Gradient Field for Latent Space Manipulation.
Minjun Li, Yanghua Jin, Huachun Zhu.
CVPR 2021. [PDF]
SeFa: Closed-Form Factorization of Latent Semantics in GANs.
Yujun Shen, Bolei Zhou.
CVPR 2021. [PDF] [Github] [Project]
L2M-GAN: Learning To Manipulate Latent Space Semantics for Facial Attribute Editing.
Guoxing Yang, Nanyi Fei, Mingyu Ding, Guangzhen Liu, Zhiwu Lu, Tao Xiang.
CVPR 2021. [PDF] [Unofficial Pytorch]
MoCoGAN-HD: A Good Image Generator Is What You Need for High-Resolution Video Synthesis.
Yu Tian, Jian Ren, Menglei Chai, Kyle Olszewski, Xi Peng, Dimitris N. Metaxas, Sergey Tulyakov.
ICLR 2021. [PDF] [Github]
GAN Steerability without optimization.
Nurit Spingarn-Eliezer, Ron Banner, Tomer Michaeli.
ICLR 2021. [OpenReview] [PDF]
GANSpace: Discovering Interpretable GAN Controls.
Erik Härkönen, Aaron Hertzmann, Jaakko Lehtinen, Sylvain Paris.
NeurIPS 2020. [PDF] [Github]
On the "steerability" of generative adversarial networks.
Ali Jahanian, Lucy Chai, Phillip Isola.
ICLR 2020. [PDF] [Project]
Interpreting the Latent Space of GANs for Semantic Face Editing.
Yujun Shen, Jinjin Gu, Xiaoou Tang, Bolei Zhou.
CVPR 2020. [PDF] [Project] [Github]
Seeing What a GAN Cannot Generate.
David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, Antonio Torralba.
ICCV 2019. [PDF] [PDF]
Unsupervised Discovery of Interpretable Directions in the GAN Latent Space.
Andrey Voynov, Artem Babenko.
ICML 2020. [PDF] [Github]
application
image generation and manipulation
DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing.
Bingchuan Li, Shaofei Cai, Wei Liu, Peng Zhang, Miao Hua, Qian He, Zili Yi.
arxiv 2021. [PDF] [Github]
In&Out: Diverse Image Outpainting via GAN Inversion.
Yen-Chi Cheng, Chieh Hubert Lin, Hsin-Ying Lee, Jian Ren, Sergey Tulyakov, Ming-Hsuan Yang.
arxiv 2021. [PDF] [Github]
InfinityGAN: Towards Infinite-Resolution Image Synthesis.
Chieh Hubert Lin, Hsin-Ying Lee, Yen-Chi Cheng, Sergey Tulyakov, Ming-Hsuan Yang.
arxiv 2021. [PDF] [Project]
Few-shot Semantic Image Synthesis Using StyleGAN Prior.
Yuki Endo, Yoshihiro Kanamori.
arxiv 2021. [PDF] [Github]
Heredity-aware Child Face Image Generation with Latent Space Disentanglement.
Xiao Cui, Wengang Zhou, Yang Hu, Weilun Wang, Houqiang Li.
arxiv 2021. [PDF]
Unsupervised Image Transformation Learning via Generative Adversarial Networks.
Kaiwen Zha, Yujun Shen, Bolei Zhou.
arxiv 2021. [PDF] [Project]
Exploring Adversarial Fake Images on Face Manifold.
Dongze Li, Wei Wang, Hongxing Fan, Jing Dong.
arxiv 2021. [PDF]
Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network.
Jialu Huang, Jing Liao, Sam Kwong.
arxiv 2020. [PDF]
Identity-Guided Face Generation with Multi-modal Contour Conditions.
Qingyan Bai, Weihao Xia, Fei Yin, Yujiu Yang.
Submitted to ICASSP 2022. [PDF]
Constrained Graphic Layout Generation via Latent Optimization.
Kotaro Kikuchi, Edgar Simo-Serra, Mayu Otani, Kota Yamaguchi.
ACM MM 2021. [PDF] [Github]
StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulation.
Wongjong Jang, Gwangjin Ju, Yucheol Jung, Jiaolong Yang, Xin Tong, Seungyong Lee.
TOG 2021. [PDF] [Github]
Coarse-to-Fine: Facial Structure Editing of Portrait Images via Latent Space Classifications.
Yiqian Wu, Yongliang Yang, Qinjie Xiao, Xiaogang Ji.
TOG 2021. [PDF] [Project]
SAM: Only a Matter of Style-Age Transformation Using a Style-Based Regression Model.
Yuval Alaluf, Or Patashnik, Daniel Cohen-Or.
TOG 2021. [PDF] [Github]
HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms.
Mahmoud Afifi, Marcus A. Brubaker, Michael S. Brown.
CVPR 2021. [PDF] [Github] [4K Landscape]
One Shot Face Swapping on Megapixels.
Yuhao Zhu, Qi Li, Jian Wang, Chengzhong Xu, Zhenan Sun.
CVPR 2021. [PDF] [Github]
LOHO: Latent Optimization of Hairstyles via Orthogonalization.
Rohit Saha, Brendan Duke, Florian Shkurti, Graham W. Taylor, Parham Aarabi.
CVPR 2021. [PDF] [Github]
StyleMapGAN: Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editing.
Hyunsu Kim, Yunjey Choi, Junho Kim, Sungjoo Yoo, Youngjung Uh.
CVPR 2021. [PDF] [Github]
DeepI2I: Enabling Deep Hierarchical Image-to-Image Translation by Transferring from GANs.
yaxing wang, Lu Yu, Joost van de Weijer.
NeurIPS 2020. [PDF] [Github]
multimodal learning
StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators.
Rinon Gal, Or Patashnik, Haggai Maron, Gal Chechik, Daniel Cohen-Or.
arxiv 2021. [PDF] [Project] [Github]
Paint by Word.
David Bau, Alex Andonian, Audrey Cui, YeonHwan Park, Ali Jahanian, Aude Oliva, Antonio Torralba.
arxiv 2021. [PDF]
CI-GAN: Cycle-Consistent Inverse GAN for Text-to-Image Synthesis.
Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao.
ACM MM 2021. [PDF]
TediGAN: Text-Guided Diverse Image Generation and Manipulation.
Weihao Xia, Yujiu Yang, Jing-Hao Xue, Baoyuan Wu.
CVPR 2021. [PDF] [Data] [Github]
DeepLandscape: Adversarial Modeling of Landscape Videos.
E. Logacheva, R. Suvorov, O. Khomenko, A. Mashikhin, and V. Lempitsky.
ECCV 2020. [PDF] [Github] [Project]
image restoration
StyleGAN-induced Data-driven Regularization for Inverse Problems.
Arthur Conmy, Subhadip Mukherjee, Carola-Bibiane Schönlieb.
Submitted to ICASSP 2022. [PDF]
GPEN: GAN Prior Embedded Network for Blind Face Restoration in the Wild.
Tao Yang, Peiran Ren, Xuansong Xie, Lei Zhang.
CVPR 2021. [PDF] [Github]
GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolution.
Kelvin C.K. Chan, Xintao Wang, Xiangyu Xu, Jinwei Gu, Chen Change Loy.
CVPR 2021. [PDF] [Project] [Github]
GFP-GAN: Towards Real-World Blind Face Restoration with Generative Facial Prior.
Xintao Wang, Yu Li, Honglun Zhang, Ying Shan.
CVPR 2021. [PDF] [Project]
PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models.
Sachit Menon, Alexandru Damian, Shijia Hu, Nikhil Ravi, Cynthia Rudin.
CVPR 2020. [PDF] [Github]
Style Generator Inversion for Image Enhancement and Animation.
Aviv Gabbay, Yedid Hoshen.
arxiv 2019. [PDF] [Project] [Github]
image understanding
Segmentation in Style: Unsupervised Semantic Image Segmentation with Stylegan and CLIP.
Daniil Pakhomov, Sanchit Hira, Narayani Wagle, Kemar E. Green, Nassir Navab.
arxiv 2021. [PDF] [Github]
Labels4Free: Unsupervised Segmentation using StyleGAN.
Rameen Abdal, Peihao Zhu, Niloy Mitra, Peter Wonka.
ICCV 2021. [PDF] [Project] [Github]
DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effort.
Yuxuan Zhang, Huan Ling, Jun Gao, Kangxue Yin, Jean-Francois Lafleche, Adela Barriuso, Antonio Torralba, Sanja Fidler.
CVPR 2021. [PDF] [Github] [Project]
Repurposing GANs for One-shot Semantic Part Segmentation.
Nontawat Tritrong, Pitchaporn Rewatbowornwong, Supasorn Suwajanakorn.
CVPR 2021 (oral). [PDF] [Project] [Github]
3D
GAN2Shape: Do 2D GANs Know 3D Shape? Unsupervised 3D shape reconstruction from 2D Image GANs.
Xingang Pan, Bo Dai, Ziwei Liu, Chen Change Loy, Ping Luo.
ICLR 2021 (oral). [PDF] [Github] [Project]
Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinement.
Huiwen Luo, Koki Nagano, Han-Wei Kung, Mclean Goldwhite, Qingguo Xu, Zejian Wang, Lingyu Wei, Liwen Hu, Hao Li.
CVPR 2021. [PDF]
Unsupervised 3D Shape Completion through GAN-Inversion.
Junzhe Zhang, Xinyi Chen, Zhongang Cai, Liang Pan, Haiyu Zhao, Shuai Yi, Chai Kiat Yeo, Bo Dai, Chen Change Loy.
CVPR 2021. [PDF] [Project]
OSTeC: One-Shot Texture Completion.
Baris Gecer, Jiankang Deng, Stefanos Zafeiriou.
CVPR 2021. [PDF] [Github]
compressed sensing
Generator Surgery for Compressed Sensing.
Niklas Smedemark-Margulies, Jung Yeon Park, Max Daniels, Rose Yu, Jan-Willem van de Meent, Paul Hand.
arxiv 2021. [PDF] [Github]
Task-Aware Compressed Sensing with Generative Adversarial Networks.
Maya Kabkab, Pouya Samangouei, Rama Chellappa.
AAAI 2018. [PDF]
medical imaging
Controllable Medical Image Generation via Generative Adversarial Networks.
Zhihang Ren, Stella X. Yu, David Whitney.
Human Vision and Electronic Imaging 2021. [PDF]
High-resolution Controllable Prostatic Histology Synthesis using StyleGAN.
Gagandeep B. Daroach, Josiah A. Yoder, Kenneth A. Iczkowski, Peter S. LaViolette.
BIOIMAGING 2021. [PDF]
security
Differentially Private Imaging via Latent Space Manipulation.
Tao Li, Chris Clifton.
arxiv 2021. [PDF]
acknowledgement
Thanks for the constructive comments from anonymous reviewers and feedback from Jun-Yan Zhu, Andrey Voynov, and Rushil Anirudh.