Giters

ZhendongWang6 / Awesome-Face-Forgery-Generation-and-Detection

A curated list of articles and codes related to face forgery generation and detection.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Awesome Face Forgery Generation and Detection Awesome

A curated list of articles and codes related to face forgery generation and detection.

Contributing

Please feel free to send me pull requests or email (clp.xidian@gmail.com) to update this list together!

Table of Contents

Target-specific Face Forgery

Face Swap

  • deepfakes/faceswap (Github) [Code]
  • iperov/DeepFaceLab (Github) [Paper] [Code]
  • Fast face-swap using convolutional neural networks (2017 ICCV) [Paper]
  • On face segmentation, face swapping, and face perception (2018 FG) [Paper] [Code]
  • RSGAN: face swapping and editing using face and hair representation in latent spaces (2018 arXiv) [Paper]
  • FSNet: An identity-aware generative model for image-based face swapping (2018 ACCV) [Paper]
  • Towards open-set identity preserving face synthesis (2018 CVPR) [Paper]
  • FSGAN: Subject Agnostic Face Swapping and Reenactment (2019 ICCV) [Paper] [Code]
  • Deepfakes for Medical Video De-Identification: Privacy Protection and Diagnostic Information Preservation (202003 arXiv) [Paper]
  • Advancing High Fidelity Identity Swapping for Forgery Detection (2020 CVPR) [Paper] [arXiv version]
  • SimSwap: An Efficient Framework For High Fidelity Face Swapping (2020 ACMMM) [Paper] [Code]
  • Using GANs to Synthesise Minimum Training Data for Deepfake Generation (202011 arXiv) [Paper]
  • FaceInpainter: High Fidelity Face Adaptation to Heterogeneous Domains (2021 CVPR) [Paper]
  • One Shot Face Swapping on Megapixels (2021 CVPR) [Paper] [Code]
  • Detecting Deep-Fake Videos from Aural and Oral Dynamics (2021 CVPRW) [Paper]
  • HifiFace: 3D Shape and Semantic Prior Guided High Fidelity Face Swapping (2021 IJCAI) [Paper] [Code] [Project]
  • ShapeEditer: a StyleGAN Encoder for Face Swapping (202106 arXiv) [Paper]

Face Manipulation

Attribute Manipulation

  • Learning residual images for face attribute manipulation (2017 CVPR) [Paper] [Code]
  • Fader networks: Manipulating images by sliding attributes (2017 NIPS) [Paper] [Code]
  • StarGAN: Unified generative adversarial networks for multi-domain image-to-image translation (2018 CVPR) [Paper] [Code]
  • Facelet-Bank for Fast Portrait Manipulation (2018 CVPR) [Paper] [Code]
  • Glow: Generative flow with invertible 1x1 convolutions (2018 NIPS) [Paper] [Code]
  • Mask-aware Photorealistic Face Attribute Manipulation (2018 arXiv) [Paper]
  • Sparsely Grouped Multi-Task Generative Adversarial Networks for Facial Attribute Manipulation (2018 ACMMM) [Paper] [Code]
  • AttGAN: Facial attribute editing by only changing what you want (2019 TIP) [Paper] [Code]
  • STGAN: A unified selective transfer network for arbitrary image attribute editing (2019 CVPR) [Paper] [Code]
  • Semantic Component Decomposition for Face Attribute Manipulation (2019 CVPR) [Paper] [Code]
  • Make a Face: Towards Arbitrary High Fidelity Face Manipulation (2019 ICCV) [Paper]
  • Towards Automatic Face-to-Face Translation (2019 ACMMM) [Paper] [Code]
  • MulGAN: Facial Attribute Editing by Exemplar (2019 arXiv) [Paper]
  • MaskGAN: Towards Diverse and Interactive Facial Image Manipulation (2019 arXiv) [Paper] [Code]
  • PuppetGAN: Cross-Domain Image Manipulation by Demonstration (2019 ICCV) [Paper] [Code]
  • StarGAN v2: Diverse Image Synthesis for Multiple Domains (2020 CVPR) [Paper] [Code]
  • Fine-Grained Expression Manipulation via Structured Latent Space (2020 ICME) [Paper] [Code]
  • Towards Photo-Realistic Facial Expression Manipulation (2020 IJCV) [Paper]
  • FaceController: Controllable Attribute Editing for Face in the Wild (2021 AAAI) [Paper]
  • High-Fidelity and Arbitrary Face Editing (2021 CVPR) [Paper] [Code]
  • HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms (2021 CVPR) [Paper] [Code]
  • High Fidelity Face Manipulation with Extreme Poses and Expressions (2021 TIFS) [Paper]
  • Cross-Domain and Disentangled Face Manipulation with 3D Guidance (202104 arXiv) [Paper] [Code]
  • Transforming the Latent Space of StyleGAN for Real Face Editing (202105 arXiv) [Paper] [Code]

Expression Reenactment

  • Real-time expression transfer for facial reenactment (2015 TOG) [Paper]
  • Face2face: Real-time face capture and reenactment of RGB videos (2016 CVPR) [Paper]
  • ReenactGAN: Learning to reenact faces via boundary transfer (2018 ECCV) [Paper] [Code]
  • HeadOn: Real-time Reenactment of Human Portrait Videos (2018 TOG) [Paper]
  • Deep video portraits (2018 TOG) [Paper]
  • ExprGAN: Facial expression editing with controllable expression intensity (2018 AAAI) [Paper] [Code]
  • Geometry guided adversarial facial expression synthesis (2018 ACMMM) [Paper]
  • GANimation: Anatomically-aware facial animation from a single image (2018 ECCV) [Paper] [Code]
  • Generating Photorealistic Facial Expressions in Dyadic Interactions (2018 BMVC) [Paper]
  • Dynamic Facial Expression Generation on Hilbert Hypersphere with Conditional Wasserstein Generative Adversarial Nets (2019 arXiv) [Paper]
  • 3D guided fine-grained face manipulation (2019 CVPR) [Paper]
  • Few-shot adversarial learning of realistic neural talking head models (2019 ICCV) [Paper] [Code1] [Code2] [Code3]
  • Deferred Neural Rendering: Image Synthesis using Neural Textures (2019 TOG) [Paper] [Code]
  • MarioNETte: Few-shot Face Reenactment Preserving Identity of Unseen Targets (2019 arXiv) [Paper]
  • Unconstrained Facial Expression Transfer using Style-based Generator (2019 arXiv) [Paper]
  • One-shot Face Reenactment (2019 BMVC) [Paper] [Code]
  • ICface: Interpretable and Controllable Face Reenactment Using GANs (2020 WACV) [Paper] [Code]
  • Realistic Face Reenactment via Self-Supervised Disentangling of Identity and Pose (202003 arXiv) [Paper]
  • APB2Face: Audio-guided face reenactment with auxiliary pose and blink signals (202004 arXiv) [Paper] [Code]
  • One-Shot Identity-Preserving Portrait Reenactment (202004 arXiv) [Paper]
  • FReeNet: Multi-Identity Face Reenactment (2020 CVPR) [Paper] [Code]
  • Learning Identity-Invariant Motion Representations for Cross-ID Face Reenactment (2020 CVPR) [Paper]
  • FaR-GAN for One-Shot Face Reenactment (202005 arXiv) [Paper]
  • ReenactNet: Real-time Full Head Reenactment (202006 arXiv) [Paper]
  • APB2FaceV2: Real-Time Audio-Guided Multi-Face Reenactment (202010 arXiv) [Paper] [Code]
  • Realistic Talking Face Synthesis With Geometry-Aware Feature Transformation (2020 ICIP) [Paper]
  • Mesh Guided One-shot Face Reenactment using Graph Convolutional Networks (2020 ACMMM) [Paper]
  • Neural Head Reenactment with Latent Pose Descriptors (2020 CVPR) [Paper] [Code]
  • Fast Bi-layer Neural Synthesis of One-Shot Realistic Head Avatars (2020 CVPR) [Paper] [Code]
  • FACEGAN: Facial Attribute Controllable rEenactment GAN (2021 WACV) [Paper] [Code]
  • One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing (2021 CVPR) [Paper] [Code]
  • One-shot Face Reenactment Using Appearance Adaptive Normalization (2021 AAAI) [Paper]
  • Pareidolia Face Reenactment (2021 CVPR) [Paper] [Code]
  • Everything's Talkin': Pareidolia Face Reenactment (2021 CVPR) [Paper]
  • LI-Net: Large-Pose Identity-Preserving Face Reenactment Network (2021 ICME) [Paper]

Cross-modality Manipulation

  • Synthesizing Obama: learning lip sync from audio (2017 TOG) [Paper] [Code]
  • Face synthesis from visual attributes via sketch using conditional VAEsand GANs (2017 arXiv) [Paper]
  • GP-GAN: Gender Preserving GAN for Synthesizing Faces from Landmarks (2018 ICPR) [Paper]
  • X2Face: A network for controlling face generation by using images, audio, and pose codes (2018 ECCV) [Paper] [Code]
  • Speech2Face: Learning the Face Behind a Voice (2019 CVPR) [Paper]
  • Face Reconstruction from Voice using Generative Adversarial Networks (2019 NIPS) [Paper]
  • Neural Voice Puppetry: Audio-driven Facial Reenactment (2019 arXiv) [Paper]
  • Realistic Speech-Driven Facial Animation with GANs (2019 IJCV) [Paper]
  • You said that?: Synthesising talking faces from audio (2019 IJCV) [Paper]
  • Text-based editing of talking-head video (2019 TOG) [Paper]
  • FTGAN: A Fully-trained Generative Adversarial Networks for Text to Face Generation (2019 arXiv) [Paper]
  • Hierarchical Cross-Modal Talking Face Generationwith Dynamic Pixel-Wise Loss (2019 CVPR) [Paper] [Code]
  • Wav2Pix: Speech-conditioned Face Generation using Generative Adversarial Networks (2019 ICASSP) [Paper] [Code]
  • Talking Face Generation by Adversarially Disentangled Audio-Visual Representation (2019 AAAI) [Paper] [Code]
  • Everybody’s Talkin’: Let Me Talk as You Want (202001 arXiv) [Paper]
  • Identity-Preserving Realistic Talking Face Generation (202005 arXiv) [Paper]
  • Talking-head Generation with Rhythmic Head Motion (2020 ECCV) [Paper] [Code]
  • FLNet: Landmark Driven Fetching and Learning Network for Faithful Talking Facial Animation Synthesis (2020 AAAI) [Paper] [Code]
  • A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild (2020 ACMMM) [Paper] [Code]
  • Talking Face Generation with Expression-Tailored Generative Adversarial Network (2020 ACMMM) [Paper]
  • From Inference to Generation: End-to-end Fully Self-supervised Generation of Human Face from Speech (2020 ICLR) [Paper]
  • Arbitrary Talking Face Generation via Attentional Audio-Visual Coherence Learning (2020 IJCAI) [Paper]
  • MakeItTalk: Speaker-Aware Talking-Head Animation (2020 Siggraph Asia) [Paper] [Code]
  • Facial Keypoint Sequence Generation from Audio (202011 arXiv) [Paper]
  • LandmarkGAN: Synthesizing Faces from Landmarks (202011 arXiv) [Paper]
  • Stochastic Talking Face Generation Using Latent Distribution Matching (202011 arXiv) [Paper]
  • StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery (202103 arXiv) [Paper] [Code]
  • TediGAN: Text-Guided Diverse Face Image Generation and Manipulation (2021 CVPR) [Paper] [Code]
  • Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (2021 CVPR) [Paper] [Code]
  • Talk-to-Edit: Fine-Grained Facial Editing via Dialog (2021 ICCV) [Paper] [Code]
  • Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose Dictionary (202104 arXiv) [Paper] [Code]
  • Controlled AutoEncoders to Generate Faces from Voices (202107 arXiv) [Paper]

Target-generic Face Forgery (Representative)

  • Generative Adversarial Nets (2014 NIPS) [Paper] [Code]
  • (DCGAN) Unsupervised representation learning with deep convolutional generative adversarial networks (2016 ICLR) [Paper] [Code]
  • (ProGAN) Progressive growing of GANs for improved quality, stability, and variation (2018 ICLR) [Paper] [Code]
  • Spectral normalization for generative adversarial networks (2018 ICLR) [Paper] [Code] [Code]
  • Self-attention generative adversarial networks (2018 arXiv) [Paper] [Code]
  • (StyleGAN) A Style-Based Generator Architecture for Generative Adversarial Networks (2019 CVPR) [Paper] [Code]
  • (BigGAN) Large Scale GAN Training for High Fidelity Natural Image Synthesis (2019 ICLR) [Paper] [Code1] [Code2]
  • (StyleGAN2) Analyzing and improving the image quality of StyleGAN (2019 arXiv) [Paper] [Code1] [Code2]
  • One-Shot Domain Adaptation For Face Generation (202003 arXiv) [Paper]
  • (ALAE) Adversarial Latent Autoencoders (2020 CVPR) [Paper] [Code]
  • (CUT) Contrastive Learning for Unpaired Image-to-Image Translation (2020 ECCV) [Paper] [Code]

Face Forgery Detection

Spatial Clue for Detection

  • Automated face swapping and its detection (2017 ICSIP) [Paper]
  • Two-stream neural networks for tampered face detection (2017 CVPRW) [Paper]
  • Can Forensic Detectors Identify GAN Generated Images? (2018 APSIPA) [Paper]
  • Deepfakes: a new threat to face recognition? assessment and detection (2018 arXiv) [Paper]
  • Identification of Deep Network Generated Images Using Disparities in Color Components (2020 Signal Processing) [Paper] [Code]
  • Fake Faces Identification via Convolutional Neural Network (2018 IH&MMSec) [Paper]
  • Learning to detect fake face images in the wild (2018 IS3C) [Paper] [Code]
  • Detecting Both Machine and Human Created Fake Face Images In the Wild (2018 MPS) [Paper]
  • Detection of Deepfake Video Manipulation (2018 IMVIP) [Paper]
  • Secure detection of image manipulation by means of random feature selection (2019 TIFS) [Paper]
  • Exploiting Human Social Cognition for the Detection of Fake and Fraudulent Faces via Memory Networks (2019 arXiv) [Paper]
  • Swapped Face Detection using Deep Learning and Subjective Assessment (2019 arXiv) [Paper]
  • Detection of Fake Images Via The Ensemble of Deep Representations from Multi Color Spaces (2019 ICIP) [Paper]
  • Detection GAN-Generated Imagery Using Saturation Cues (2019 ICIP) [Paper]
  • Detecting GAN generated fake images using co-occurrence matrices (2019 Electronic Imaging) [Paper]
  • Exposing DeepFake Videos By Detecting Face Warping Artifacts (2019 CVPRW) [Paper] [Code]
  • Exposing GAN-synthesized Faces Using Landmark Locations (2019 arXiv) [Paper]
  • Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations (2019 WACVW) [Paper] [Code]
  • Detecting and Simulating Artifacts in GAN Fake Images (2019 WIFS) [Paper] [Code]
  • On the detection of digital face manipulation (2019 arXiv) [Paper]
  • On the generalization of GAN image forensics (2019 CCBR) [Paper]
  • Unmasking DeepFakes with simple Features (2019 arXiv) [Paper] [Code]
  • Face image manipulation detection based on a convolutional neural network (2019 ESWA) [Paper]
  • Do GANs leave artificial fingerprints? (2019 MIPR) [Paper]
  • Attributing fake images to GANs: Learning and analyzing GAN fingerprints (2019 ICCV) [Paper] [Code]
  • Multi-task learning for detecting and segmenting manipulated facial images and videos (2019 BTAS) [Paper] [Code]
  • Poster: Towards Robust Open-World Detection of Deepfakes (2019 CCS) [Paper]
  • Extracting deep local features to detect manipulated images of human faces (2019 arXiv) [Paper]
  • Zooming into Face Forensics: A Pixel-level Analysis (2019 arXiv) [Paper]
  • Fakespotter: A simple baseline for spotting ai-synthesized fake faces (2019 arXiv) [Paper]
  • Capsule-forensics: Using capsule networks to detect forged images and videos (2019 ICASSP) [Paper] [Code]
  • Use of a Capsule Network to Detect Fake Images and Videos (2019 arXiv) [Paper] [Code]
  • Deep Fake Image Detection based on Pairwise Learning (2020 Applied Science) [Paper]
  • Detecting Face2Face Facial Reenactment in Videos (2020 WACV) [Paper]
  • FakeLocator: Robust Localization of GAN-Based Face Manipulations via Semantic Segmentation Networks with Bells and Whistles (2020 arXiv) [Paper]
  • FDFtNet: Facing Off Fake Images using Fake Detection Fine-tuning Network (2020 arXiv) [Paper] [Code]
  • Global Texture Enhancement for Fake Face Detection in the Wild (2020 arXiv) [Paper]
  • Detecting Deepfakes with Metric Learning (202003 arXiv) [Paper]
  • Fake Generated Painting Detection via Frequency Analysis (202003 arXiv) [Paper]
  • Leveraging Frequency Analysis for Deep Fake Image Recognition (202003 arXiv) [Paper] [Code]
  • One-Shot GAN Generated Fake Face Detection (202003 arXiv) [Paper]
  • DeepFake Detection by Analyzing Convolutional Traces (2020 CVPRW) [Paper] [Website]
  • DeepFakes Evolution: Analysis of Facial Regions and Fake Detection Performance (202004 arXiv) [Paper]
  • On the use of Benford's law to detect GAN-generated images (202004 arXiv) [Paper] [Code]
  • Video Face Manipulation Detection Through Ensemble of CNNs (202004 arXiv) [Paper] [Code]
  • Detecting Forged Facial Videos using convolutional neural network (202005 arXiv) [Paper]
  • Fake Face Detection via Adaptive Residuals Extraction Network (202005 arXiv) [Paper] [Code]
  • Manipulated Face Detector: Joint Spatial and Frequency Domain Attention Network (202005 arXiv) [Paper]
  • A Face Preprocessing Approach for Improved DeepFake Detection (202006 arXiv) [Paper]
  • A Note on Deepfake Detection with Low-Resources (202006 arXiv) [Paper]
  • Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues (2020 ECCV) [Paper]
  • CNN Detection of GAN-Generated Face Images based on Cross-Band Co-occurrences Analysis (2020 WIFS) [Paper] [Code]
  • Detection, Attribution and Localization of GAN Generated Images (202007 arXiv) [Paper]
  • Two-branch Recurrent Network for Isolating Deepfakes in Videos (202008 arXiv) [Paper]
  • What makes fake images detectable? Understanding properties that generalize (2020 ECCV) [Paper] [Code]
  • DeepFake Detection Based on Discrepancies Between Faces and their Context (202008 arXiv) [Paper]
  • Deep Detection for Face Manipulation (202009 arXiv) [Paper]
  • Exposing GAN-generated faces using inconsistent corneal specular highlights (2021 ICASSP) [Paper]
  • Face Forgery Detection by 3D Decomposition (202011 arXiv) [Paper]
  • Identifying Invariant Texture Violation for Robust Deepfake Detection (202012 arXiv) [Paper]
  • Learning to Recognize Patch-Wise Consistency for Deepfake Detection (202012 arXiv) [Paper]
  • Fourier Spectrum Discrepancies in Deep Network Generated Images (2020 NIPS) [Paper] [Code]
  • Gradient-Based Illumination Description for Image Forgery Detection (2020 TIFS) [Paper]
  • Fighting deepfakes by detecting GAN DCT anomalies (202101 arXiv) [Paper]
  • Adversarially robust deepfake media detection using fused convolutional neural network predictions (202102 arXiv) [Paper]
  • Deepfake Video Detection Using Convolutional Vision Transformer (202102 arXiv) [Paper] [Code]
  • Facial Manipulation Detection Based on the Color Distribution Analysis in Edge Region (202102 arXiv) [Paper]
  • Improving DeepFake Detection Using Dynamic Face Augmentation (202102 arXiv) [Paper]
  • Am I a Real or Fake Celebrity? Measuring Commercial Face Recognition Web APIs under Deepfake Impersonation Attack (202103 arXiv) [Paper]
  • DefakeHop: A Light-Weight High-Performance Deepfake Detector (2021 ICME) [Paper] [Code]
  • Detection and Localization of Facial Expression Manipulations (202103 arXiv) [Paper]
  • Multi-attentional Deepfake Detection (2021 CVPR) [Paper] [Code]
  • Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domain (2021 CVPR) [Paper]
  • Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detection (2021 CVPR) [Paper]
  • Finding Facial Forgery Artifacts with Parts-Based Detectors (2021 CVPRW) [Paper]
  • Practical Face Swapping Detection Based on Identity Spatial Constraints (2021 IJCB) [Paper]
  • Visual-Semantic Transformer for Face Forgery Detection (2021 IJCB) [Paper]
  • PRRNet: Pixel-Region relation network for face forgery detection (2021 Pattern Recognition) [Paper]
  • Fighting Fake News: Two Stream Network for Deepfake Detection via Learnable SRM (2021 IEEE TBIOM) [Paper]
  • Inconsistency-Aware Wavelet Dual-Branch Network for Face Forgery Detection (2021 IEEE TBIOM) [Paper]
  • Detection of Fake and Fraudulent Faces via Neural Memory Networks (2021 IEEE TIFS) [Paper]
  • Deepfake Detection Scheme Based on Vision Transformer and Distillation (202104 arXiv) [Paper]
  • M2TR: Multi-modal Multi-scale Transformers for Deepfake Detection (202104 arXiv) [Paper] [Code]
  • Robust Face-Swap Detection Based on 3D Facial Shape Information (202104 arXiv) [Paper]
  • Local Relation Learning for Face Forgery Detection (2021 AAAI) [Paper]
  • Interpretable Face Manipulation Detection via Feature Whitening (202106 arXiv) [Paper]
  • Learning to Disentangle GAN Fingerprint for Fake Image Attribution (202106 arXiv) [Paper]
  • Wavelet-Packet Powered Deepfake Image Detection (202106 arXiv) [Paper] [Code]

Temporal Clue for Detection

  • Mesonet: a compact facial video forgery detection network (2018 WIFS) [Paper] [Code]
  • In Ictu Oculi: Exposing AI created fake videos by detecting eye blinking (2018 WIFS) [Paper] [Code]
  • Deepfake Video Detection Using Recurrent Neural Networks (2018 AVSS) [Paper]
  • Exposing deep fakes using inconsistent head poses (2019 ICASSP) [Paper]
  • Protecting world leaders against deep fakes (2019 CVPRW) [Paper]
  • FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals (2019 arXiv) [Paper]
  • Recurrent Convolutional Strategies for Face Manipulation Detection in Videos (2019 CVPRW) [Paper]
  • Predicting Heart Rate Variations of Deepfake Videos using Neural ODE (2019 ICCVW) [Paper]
  • Deepfake Video Detection through Optical Flow based CNN (2019 ICCVW) [Paper]
  • Deep Face Forgery Detection (202004 arXiv) [Paper]
  • Deepfakes Detection with Automatic Face Weighting (2020 CVPRW) [Paper]
  • Detecting Deep-Fake Videos from Appearance and Behavior (202004 arXiv) [Paper]
  • Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches (2020 CVPRW) [Paper]
  • Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency (2020 CVPRW) [Paper] [Code]
  • Not made for each other– Audio-Visual Dissonance-based Deepfake Detection and Localization (2020 ACMMM) [Paper] [Code]
  • DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms (202006 arXiv) [Paper]
  • Deepfake Detection using Spatiotemporal Convolutional Networks (202006 arXiv) [Paper] [Code]
  • Interpretable Deepfake Detection via Dynamic Prototypes (202006 arXiv) [Paper]
  • Dynamic texture analysis for detecting fake faces in video sequences (202007 arXiv) [Paper]
  • Detecting Deepfake Videos: An Analysis of Three Techniques (202007 arXiv) [Paper]
  • Sharp Multiple Instance Learning for DeepFake Video Detection (2020 ACMMM) [Paper] [Code]
  • Emotions Don't Lie: A Deepfake Detection Method using Audio-Visual Affective Cues (2020 ACMMM) [Paper]
  • How Do the Hearts of Deep Fakes Beat? Deep Fake Source Detection via Interpreting Residuals with Biological Signals (2020 ICB) [Paper]
  • A Convolutional LSTM based Residual Network for Deepfake Video Detection (202009 arXiv) [Paper]
  • DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimation (202010 arXiv) [Paper] [Code]
  • ID-Reveal: Identity-aware DeepFake Video Detection (202012 arXiv) [Paper] [Code]
  • Detecting Deepfake Videos Using Euler Video Magnification (202101 arXiv) [Paper]
  • FakeBuster: A DeepFakes Detection Tool for Video Conferencing Scenarios (202101 arXiv) [Paper]
  • Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Tracking (202101 arXiv) [Paper]
  • Do Deepfakes Feel Emotions? A Semantic Approach to Detecting Deepfakes Via Emotional Inconsistencies (2021 CVPRW) [Paper]
  • Bita-Net: Bi-temporal Attention Network for Facial Video Forgery Detection (2021 IJCB) [Paper]
  • Identifying Rhythmic Patterns for Face Forgery Detection and Categorization (2021 IJCB) [Paper]
  • Interpretable and Trustworthy Deepfake Detection via Dynamic Prototypes (2021 WACV) [Paper]
  • Detection of Deepfake Videos Using Long Distance Attention (202106 arXiv) [Paper]
  • Combining EfficientNet and Vision Transformers for Video Deepfake Detection (202107 arXiv) [Paper] [Code]

Generalizable Forgery Detection

  • ForensicTransfer: Weakly-supervised domain adaptation for forgery detection (2018 arXiv) [Paper]
  • Towards generalizable forgery detection with locality-aware autoencoder (2019 arXiv) [Paper]
  • Incremental learning for the detection and classification of GAN-generated images (2019 arXiv) [Paper]
  • CNN-generated images are surprisingly easy to spot... for now (2019 arXiv) [Paper] [Code]
  • Face X-ray for More General Face Forgery Detection (2020 CVPR) [Paper]
  • Detecting CNN-Generated Facial Images in Real-World Scenarios (2020 CVPRW) [Paper]
  • OC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder (2020 CVPRW) [Paper]
  • T-GD: Transferable GAN-generated Images Detection Framework (2020 ICML) [Paper] [Code]
  • Exposing Deep-faked Videos by Anomalous Co-motion Pattern Detection (202008 arXiv) [Paper]
  • Spatio-temporal Features for Generalized Detection of Deepfake Videos (202010 arXiv) [Paper]
  • Mining Generalized Features for Detecting AI-Manipulated Fake Faces (202010 arXiv) [Paper]
  • Domain General Face Forgery Detection by Learning to Weight (2021 AAAI) [Paper] [Code]
  • Fake face detection via adaptive manipulation traces extraction network (2021 CVIU) [Paper] [Code]
  • Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection (202011 arXiv) [Paper]
  • Identity-Driven DeepFake Detection (202012 arXiv) [Paper]
  • Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection (202012 arXiv) [Paper]
  • Fake-image detection with Robust Hashing (202102 arXiv) [Paper]
  • AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection (2020 NIPS) [Paper] [Code]
  • Leveraging edges and optical flow on faces for deepfake detection (2020 ICB) [Paper]
  • Deepfake Forensics via An Adversarial Game (202103 arXiv) [Paper]
  • Generalizing Face Forgery Detection with High-frequency Features (202103 arXiv) [Paper]
  • Metric Learning for Anti-Compression Facial Forgery Detection (202103 arXiv) [Paper]
  • Towards Generalizable and Robust Face Manipulation Detection via Bag-of-local-feature (202103 arXiv) [Paper]
  • Improving the Efficiency and Robustness for Deepfakes Detection through Precise Geometric Features (2021 CVPR) [Paper] [Code]
  • Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detection (2021 CVPR) [Paper] [Code]
  • Representative Forgery Mining for Fake Face Detection (2021 CVPR) [Paper] [Code]
  • FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learning (2021 CVPRW) [Paper]
  • On the Robustness and Generalizability of Face Synthesis Detection Methods (2021 CVPRW) [Paper]
  • Are GAN generated images easy to detect? A critical analysis of the state-of-the-art (202104 arXiv) [Paper]
  • DeepfakeUCL: Deepfake Detection via Unsupervised Contrastive Learning (202104 arXiv) [Paper]
  • Unified Detection of Digital and Physical Face Attacks (202104 arXiv) [Paper]
  • Beyond the Spectrum: Detecting Deepfakes via Re-synthesis (2021 IJCAI) [Paper] [Code]
  • One Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework (2021 WWW) [Paper] [Code]
  • TAR: Generalized Forensic Framework to Detect Deepfakes using Weakly Supervised Learning (202105 arXiv) [Paper] [Code]
  • Towards Discovery and Attribution of Open-world GAN Generated Images (202105 arXiv) [Paper]
  • Automated Deepfake Detection (202106 arXiv) [Paper]

Spoofing Forgery Detection

  • Security of Facial Forensics Models Against Adversarial Attacks (2019 arXiv) [Paper]
  • Real or Fake? Spoofing State-Of-The-Art Face Synthesis Detection Systems (2019 arXiv) [Paper]
  • Adversarial Perturbations Fool Deepfake Detectors (2020 IJCNN) [Paper] [Code]
  • Disrupting DeepFakes: Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systems (202003 arXiv) [Paper] [Code]
  • Evading Deepfake-Image Detectors with White- and Black-Box Attacks (202004 arXiv) [Paper]
  • Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Faces (202006 arXiv) [Paper]
  • Disrupting Deepfakes with an Adversarial Attack that Survives Training (202006 arXiv) [Paper]
  • FakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstruction (202006 arXiv) [Paper]
  • Protecting Against Image Translation Deepfakes by Leaking Universal Perturbations from Black-Box Neural Networks (202006 arXiv) [Paper]
  • Not My Deepfake: Towards Plausible Deniability for Machine-Generated Media (202008 arXiv) [Paper]
  • FakeRetouch: Evading DeepFakes Detection via the Guidance of Deliberate Noise (202009 arXiv) [Paper]
  • Perception Matters: Exploring Imperceptible and Transferable Anti-forensics for GAN-generated Fake Face Imagery Detection (202010 arXiv) [Paper] [Code]
  • Adversarial Threats to DeepFake Detection: A Practical Perspective (202011 arXiv) [Paper]
  • Exploring Adversarial Fake Images on Face Manifold (202101 arXiv) [Paper]
  • Landmark Breaker: Obstructing DeepFake By Disturbing Landmark Extraction (202102 arXiv) [Paper]
  • A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detection (202103 arXiv) [Paper] [Code]
  • MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakes (2021 CVPR) [Paper]
  • A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detection (2021 CVPR) [Paper] [Code]
  • Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examples (2021 WACV) [Paper] [Project]
  • Making GAN-Generated Images Difficult To Spot: A New Attack Against Synthetic Image Detectors (202104 arXiv) [Paper]
  • Imperceptible Adversarial Examples for Fake Image Detection (2021 ICIP) [Paper]
  • Understanding the Security of Deepfake Detection (202107 arXiv) [Paper]

Challenges

  • DeeperForensics Challenge 2020 on Real-World Face Forgery Detection: Methods and Results (2020 ECCV) [Paper] [Website]
  • DFGC 2021: A DeepFake Game Competition (2021 IJCB) [Paper] [Website]

Others

  • Detecting Video Speed Manipulation (2020 CVPRW) [Paper]
  • The eyes know it: FakeET- An Eye-tracking Database to Understand Deepfake Perception (202006 arXiv) [Paper]
  • Deepfake detection humans vs machines (202009 arXiv) [Paper]
  • DeepFake-o-meter: An Open Platform for DeepFake Detection (202103 arXiv) [Paper] [Code] [Website]
  • An Examination of Fairness of AI Models for Deepfake Detection (2021 IJCAI) [Paper]
  • What's wrong with this video? Comparing Explainers for Deepfake Detection (202105 arXiv) [Paper]

Databases

  • [FFW] Fake Face Detection Methods: Can They Be Generalized? (2018 BIOSIG) [Paper] [Download]
  • [UADFV] In Ictu Oculi: Exposing AI created fake videos by detecting eye blinking (2018 WIFS) [Paper] [Download]
  • [DeepfakeTIMIT] Deepfakes: a new threat to face recognition? assessment and detection (2018 arXiv) [Paper] [Download]
  • [FaceForensics++ & DFD] FaceForensics++: Learning to Detect Manipulated Facial Images (2019 ICCV) [Paper] [Download]
  • [Celeb-DF] Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensics (2020 CVPR) [Paper] [Download]
  • [DFFD (Diverse Fake Face Dataset)] On the detection of digital face manipulation (2019 arXiv) [Paper]
  • [DFDC (Deepfake Detection Challenge)] The Deepfake Detection Challenge (DFDC) Preview Dataset (2019 arXiv) [Paper] [Download]
  • [DeeperForensics-1.0] DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection (2020 arXiv) [Paper] [Download]
  • [WildDeepfake] WildDeepfake: A Challenging Real-World Dataset for Deepfake Detection (202101 arXiv) [Paper] [Download]
  • [DF-W] Deepfakes in the Wild: Detection and Analysis (2021 ACM WWW) [Paper] [Download]
  • [FFIW] Face Forensics in the Wild (2021 CVPR) [Paper] [Download]
  • [ForgeryNet] ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis (2021 CVPR) [Paper] [Download]
  • [KoDF] KoDF: A Large-scale Korean DeepFake Detection Dataset (202103 arXiv) [Paper] [Download]

Survey

  • Deep Learning for Deepfakes Creation and Detection (2019 arXiv) [Paper]
  • DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection (2020 Information Fusion) [Paper]
  • Media Forensics and DeepFakes: an Overview (2020 arXiv) [Paper]
  • DeepFake Detection: Current Challenges and Next Steps (202003 arXiv) [Paper]
  • The Creation and Detection of Deepfakes: A Survey (202004 arXiv) [Paper]
  • Countering Malicious DeepFakes: Survey, Battleground, and Horizon (202103 arXiv) [Paper]
  • Unified Detection of Digital and Physical Face Attacks (202104 arXiv) [Paper]
  • Deep Fake Detection: Survey of Facial Manipulation Detection Solutions (202106 arXiv) [Paper]

Related Links

License

CC0

About

A curated list of articles and codes related to face forgery generation and detection.