lzhbrian / image-to-image-papers

🦓<->🦒 🌃<->🌆 A collection of image to image papers with code (constantly updating)

Image-to-Image papers

A collection of image-to-image papers.

Papers are ordered in arXiv first version submitting time (if applicable).

Feel free to send a PR or issue.

TOC

• Supervised
• Unsupervised
  • Unsupervised - General
  • Unsupervised - Attention/Instance guided
  • Unsupervised - Many-to-many (Attributes)
  • Unsupervised - Disentangled (and/or Exemplar guided)
• To be classified

Supervised

Note	Model	Paper	Conference	paper link	code link
	pix2pix	Image-to-Image Translation with Conditional Adversarial Networks	CVPR 2017	1611.07004	junyanz/pytorch-CycleGAN-and-pix2pix
texture guided	TextureGAN	TextureGAN: Controlling Deep Image Synthesis with Texture Patches	CVPR 2018	1706.02823	janesjanes/Pytorch-TextureGAN
	Contextual GAN	Image Generation from Sketch Constraint Using Contextual GAN	ECCV 2018	1711.08972
	pix2pix-HD	High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs	CVPR 2018	1711.11585	NVIDIA/pix2pixHD
one-to-many	BicycleGAN	Toward Multimodal Image-to-Image Translation	NIPS 2017	1711.11586	junyanz/BicycleGAN
keypoint guided	G2-GAN	Geometry Guided Adversarial Facial Expression Synthesis	MM 2018	1712.03474
	contour2im	Smart, Sparse Contours to Represent and Edit Images	CVPR 2018	1712.08232	website
disentangle	Cross-domain disentanglement networks	Image-to-image translation for cross-domain disentanglement	NIPS 2018	1805.09730
gesture	GestureGAN	GestureGAN for Hand Gesture-to-Gesture Translation in the Wild	MM 2018	1808.04859	Ha0Tang/GestureGAN
video	vid2vid	Video-to-Video Synthesis	NIPS 2018	1808.06601	NVIDIA/vid2vid
video	pix2pix-HD + Temporal Smoothing + faceGAN	Everybody Dance Now	ECCVW 2018	1808.07371	website
(un)supervised	MSGAN	Mode Seeking Generative Adversarial Networks for Diverse Image Synthesis	CVPR 2019	1903.05628	HelenMao/MSGAN
semantic to image	SPADE	Semantic Image Synthesis with Spatially-Adaptive Normalization	CVPR 2019	1903.07291	NVlabs/SPADE
Edge and color domain to reconstrcut image	PI-REC	PI-REC: Progressive Image Reconstruction Network With Edge and Color Domain		1903.10146	youyuge34/PI-REC
Cross-view image translation	SelectionGAN	Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translation	CVPR 2019	1904.06807	Ha0Tang/SelectionGAN
keypoint guided	C2-GAN	Cycle In Cycle Generative Adversarial Networks for Keypoint-Guided Image Generation	MM 2019	1908.00999
Few shot, video	Few-shot vid2vid	Few-shot Video-to-Video Synthesis	NeurIPS 2019	1910.12713	NVlabs/few-shot-vid2vid

Unsupervised

Unsupervised - General

Note	Model	Paper	Conference	paper link	code link
	DTN	Unsupervised Cross-Domain Image Generation	ICLR 2017	1611.02200	yunjey/domain-transfer-network (unofficial)
	UNIT	Unsupervised image-to-image translation networks	NIPS 2017	1703.00848	mingyuliutw/UNIT
	DiscoGAN	Learning to Discover Cross-Domain Relations with Generative Adversarial Networks	ICML 2017	1703.05192	SKTBrain/DiscoGAN
	CycleGAN	Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks	ICCV 2017	1703.10593	junyanz/pytorch-CycleGAN-and-pix2pix
	DualGAN	DualGAN: Unsupervised Dual Learning for Image-to-Image Translation	ICCV 2017	1704.02510	duxingren14/DualGAN
	DistanceGAN	One-Sided Unsupervised Domain Mapping	NIPS 2017	1706.00826	sagiebenaim/DistanceGAN
	SisGAN	SisGAN: Semantic Image Synthesis via Adversarial Learning	ICCV 2017	1707.06873	woozzu/dong_iccv_2017
semi supervised	Triangle GAN	Triangle Generative Adversarial Networks	NIPS 2017	1709.06548	LiqunChen0606/Triangle-GAN
	CartoonGAN	CartoonGAN: Generative Adversarial Networks for Photo Cartoonization	CVPR 2018	thecvf	FlyingGoblin/CartoonGAN, unofficial test, unofficial pytorch
non-adversarial	NAM	NAM: Non-Adversarial Unsupervised Domain Mapping	ECCV 2018	1806.00804	facebookresearch/nam
	SCAN	Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks	ECCV 2018	1807.08536
dilated conv, improve shape deform.	GANimorph	Improved Shape Deformation in Unsupervised Image to Image Translation	ECCV 2018	1808.04325	brownvc/ganimorph
video	Recycle-GAN	Recycle-GAN: Unsupervised Video Retargeting	ECCV 2018	1808.05174	aayushbansal/Recycle-GAN
	OT-CycleGAN	Guiding the One-to-one Mapping in CycleGAN via Optimal Transport	AAAI 2019	1811.06284
	Art2Real	Art2Real: Unfolding the Reality of Artworks via Semantically-Aware Image-to-Image Translation	CVPR 2019	1811.10666	aimagelab/art2real
latent cross-consistency	CrossNet	CrossNet: Latent Cross-Consistency for Unpaired Image Translation	WACV 2020	1901.04530
	HarmonicGAN	Harmonic Unpaired Image-to-image Translation	ICLR 2019	1902.09727
Person Generation	DG-Net	Joint Discriminative and Generative Learning for Person Re-identification	CVPR 2019	1904.07223	NVlabs/DG-Net
	TransGaGa	TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translation	CVPR 2019	1904.09571	project
	AGUIT	Attribute Guided Unpaired Image-to-Image Translation with Semi-supervised Learning		1904.12428	imlixinyang/AGUIT
few shot	FUNIT	Few-Shot Unsupervised Image-to-Image Translation	ICCV 2019	1905.01723	project, nvlabs/FUNIT
zero shot	ZstGAN	ZstGAN: An Adversarial Approach for Unsupervised Zero-Shot Image-to-Image Translation		1906.00184	linjx-ustc1106/ZstGAN-PyTorch
		Cross-Domain Cascaded Deep Feature Translation		1906.01526
		Breaking the cycle -- Colleagues are all you need.		1911.10538

Unsupervised - Attention/Instance guided

Note	Model	Paper	Conference	paper link	code link
mask	ContrastGAN	Generative Semantic Manipulation with Mask-Contrasting GAN	ECCV 2018	1708.00315
attention	DA-GAN	DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks	CVPR 2018	1802.06454
mask / attention	Attention-GAN	Attention-GAN for Object Transfiguration in Wild Images	ECCV 2018	1803.06798
attention	Attention guided GAN	Unsupervised Attention-guided Image to Image Translation	NIPS 2018	1806.02311	AlamiMejjati/Unsupervised-Attention-guided-Image-to-Image-Translation
attention, one-sided		Show, Attend and Translate: Unsupervised Image Translation with Self-Regularization and Attention	TIP 2019	1806.06195
instance aware - mask	InstaGAN	Instance-aware image-to-image translation	ICLR 2019	openreview	sangwoomo/instagan
	AttentionGAN	Attention-Guided Generative Adversarial Networks for Unsupervised Image-to-Image Translation	IJCNN 2019	1903.12296	Ha0Tang/AttentionGAN
instance level - bbox	INIT	Towards Instance-level Image-to-Image Translation	CVPR 2019	1905.01744	project
mask guided		Mask-Guided Portrait Editing with Conditional GANs	CVPR 2019	1905.10346	cientgu/Mask_Guided_Portrait_Editing
	U-GAT-IT	U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation	ICLR 2020	1907.10830	taki0112/UGATIT, znxlwm/UGATIT-pytorch

Unsupervised - Many-to-many (Attributes)

Note	Model	Paper	Conference	paper link	code link
	IcGAN	Invertible Conditional GANs for image editing	NIPSW 2016	1611.06355	Guim3/IcGAN
	Conditional CycleGAN	Conditional CycleGAN for Attribute Guided Face Image Generation	ECCV 2018	1705.09966
	StarGAN	StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation	CVPR 2018	1711.09020	yunjey/StarGAN
	AttGAN	AttGAN: Facial Attribute Editing by Only Changing What You Want	TIP 2019	1711.10678	LynnHo/AttGAN-Tensorflow
	ComboGAN	ComboGAN: Unrestrained Scalability for Image Domain Translation	CVPRW 2018	1712.06909	AAnoosheh/ComboGAN
	AugCGAN (Augmented CycleGAN)	Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data	ICML 2018	1802.10151	aalmah/augmented_cyclegan
	ModularGAN	Modular Generative Adversarial Networks	ECCV 2018	1804.03343
sparsely grouped dataset	SG-GAN	Sparsely Grouped Multi-task Generative Adversarial Networks for Facial Attribute Manipulation	MM 2018	1805.07509	zhangqianhui/Sparsely-Grouped-GAN
	GANimation	GANimation: Anatomically-aware Facial Animation from a Single Image	ECCV 2018	1807.09251	albertpumarola/GANimation
	SingleGAN	SingleGAN: Image-to-Image Translation by a Single-Generator Network using Multiple Generative Adversarial Learning	ACCV 2018	1810.04991	Xiaoming-Yu/SingleGAN
	SMIT	SMIT: Stochastic Multi-Label Image-to-Image Translation	ICCVW 2019	1812.03704	BCV-Uniandes/SMIT
	InjectionGAN	Toward Learning a Unified Many-to-Many Mapping for Diverse Image Translation		1905.08766
		Image-to-Image Translation with Multi-Path Consistency Regularization	IJCAI 2019	1905.12498
	RelGAN	RelGAN: Multi-Domain Image-to-Image Translation via Relative Attributes	ICCV 2019	1908.07269	elvisyjlin/RelGAN-PyTorch, willylulu/RelGAN
	StarGAN v2	StarGAN v2: Diverse Image Synthesis for Multiple Domains	CVPR 2020	1912.01865	clovaai/stargan-v2

Unsupervised - Disentangled (and/or Exemplar guided)

Note	Model	Paper	Conference	paper link	code link
	XGAN	XGAN: Unsupervised Image-to-Image Translation for Many-to-Many Mappings	ICML 2018	1711.05139	dataset
	ELEGANT	ELEGANT: Exchanging Latent Encodings with GAN for Transferring Multiple Face Attributes	ECCV 2018	1803.10562	Prinsphield/ELEGANT
	MUNIT	Multimodal Unsupervised Image-to-Image Translation	ECCV 2018	1804.04732	NVlabs/MUNIT
	cd-GAN (Conditional DualGAN)	Conditional Image-to-Image Translation	CVPR 2018	1805.00251
	EG-UNIT	Exemplar Guided Unsupervised Image-to-Image Translation	ICLR 2019	1805.11145
	PairedCycleGAN	PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup	CVPR 2018	thecvf
	DRIT	Diverse Image-to-Image Translation via Disentangled Representations	ECCV 2018	1808.00948	HsinYingLee/DRIT
	UFDN	A Unified Feature Disentangler for Multi-Domain Image Translation and Manipulation	NIPS 2018	1809.01361	Alexander-H-Liu/UFDN
non-disentangle, face makeup guided	BeautyGAN	BeautyGAN: Instance-level Facial Makeup Transfer with Deep Generative Adversarial Network	MM 2018	author	wtjiang98/BeautyGAN_pytorch
	GDWCT	Image-to-Image Translation via Group-wise Deep Whitening and Coloring Transformation	CVPR 2019	1812.09912	WonwoongCho/GDWCT
	DRIT++	DRIT++: Diverse Image-to-Image Translation via Disentangled Representations	IJCV 2020	1905.01270	project, HsinYingLee/MDMM
	HiDT	High-Resolution Daytime Translation Without Domain Labels	CVPR 2020	2003.08791	project, saic-mdal/HiDT

To be classified

• EDIT: Exemplar-Domain Aware Image-to-Image Translation. https://arxiv.org/abs/1911.10520

• Multi-mapping Image-to-Image Translation via Learning Disentanglement. https://arxiv.org/abs/1909.07877. NeurIPS 2019. https://github.com/Xiaoming-Yu/DMIT

• GANHOPPER: Multi-Hop GAN for Unsupervised Image-to-Image Translation. https://arxiv.org/abs/2002.10102

• GMM-UNIT: Unsupervised Multi-Domain and Multi-Modal Image-to-Image Translation via Attribute Gaussian Mixture Modeling. https://arxiv.org/abs/2003.06788.