subinium / Evaluation-of-GANs

Evaluation of GANs

Based On Pros and Cons of GAN Evaluation Measures: New Developments (Ali Borji)

Quantitative Evaluation Measures

FID & IS

Method	Venue	code
Inception Score (IS)	NeurIPS 2016
Fréchet Inception Distance (FID)	NeurIPS 2017

FID & IS Variants

Method	Venue	code
Spatial FID (sFID)	ICML 2021
Class-aware FID (CAFD)	arXiv 2018	code
Conditional FID	arXiv 2021
Fast FID	arXiv 2021
Memorization-informed FID (MiFID)	KDD 2021
Unbiased FID and IS	CVPR 2020
Clean FID	arXiv 2021	code
Frechet Video Distance (FVD)	arXiv 2018	code

Method based on Analysing Data Manifold

Method	Venue	code
Local Intrinsic Dimensionality (LID)	arXiv 2019
Intrinsic Multi-scale Distance (IMD)	ICLR 2020
Perceptual Path Length (PPL)	CVPR 2019	code
Linear Separability in Latent Space	CVPR 2019	code

New Ideas based on Precision and Recall (P&R)

Method	Venue	code
Precision and Recall (P&R)	NeurIPS 2018
Improved P&R	NeurIPS 2019	code
Density and Coverage (D&C)	ICML 2020	code
Alpha Precision & Recall	arXiv 2021

Text-Image

Method	Venue	code
Caption Score (CapS)	NeurIPS 2021	code

ETC

Method	Venue	code
Classification Accuracy Score (CAS)	NeurIPS 2019
Duality GAP Metric	NeurIPS 2019

Qualititative Evaluation Measures

Method	Venue	code
Human Eye Perceptual Evaluation (HYPE)	NeurIPS 2019
Neuroscore	Cognitive Computation 2020
GAN Steerability & Dissection	ICLR 2020	code
A Universal Fake vs. Real Detector	CVPR 2020