Notice

Update 2024: CLRNet, ShallowNet, MesoInception4, and Xception weights are now available to download from the Google Drive link below.

update 2022: CLRNet Files and weights are temporarily removed. Contact the authors via email for access.

Overview

Title: One Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework (WWW '21) (arXiv)

Citation

If you find our work useful for your research, please consider citing the following papers :)

@inproceedings{tariq2021web,
  title={One Detector to Rule Them All: Towards a General Deepfake Attack Detection Framework},
  author={Tariq, Shahroz and Lee, Sangyup and Woo, Simon S},
  booktitle={Proceedings of The Web Conference 2021},
  year={2021},
  url = {https://doi.org/10.1145/3442381.3449809},
  doi = {10.1145/3442381.3449809}
}

Pretrained weights

The following link contains the weights for the models (CLRNet [CLR], ShallowNetV3 [SNV3], MesoInception4 [M14], and Xception [XCE]) used in our experiments

https://drive.google.com/drive/folders/1CE-HzZh76ejAsrIFSlbaEGmQHyzoj9EQ?usp=sharing

Additional Results

Updated in-domain attack results including DFDC dataset

Note that CLRNet performs the best for DFDC dataset among all the test baselines.

Updated out-of-domain attack results (before using our defense strategy)

Note that results from Table 5 demonstrates that models trained on DFDC, which is a quite generic and diverse dataset, can still fail to detect out-of-domain attack (see Table 5).
See Table 6 in our paper, for defense performance against out-of-domain attack.

Dataset used for Evaluation

Facial Reenactment
- Face2Face (F2F) [Dataset] [Paper]
- Neural Texture (NT) [Dataset] [Paper]
Identity Swap
- DeepFake (DF) [Dataset] [GitHub]
- FaceSwap (FS) [Dataset] [GitHub]
- DeepFake Detection (DFD) [Dataset] [Blog]
- DeepFake Detection Challenge (DFDC) [Dataset] [Paper] [Kaggle Challenge] [Blog]
Unknown
- DeepFake in the Wild (DFW) [Sample Links] [Source1] [Source2] [Source3]

Models used for Evaluation

Single Frame-based
- ShallowNet [Paper] [GitHub]
- Xception [Paper] [GitHub]
- MesoNet [Paper] [GitHub]
Multiple Frame-based
- CNN+LSTM [Paper]
- DBiRNN [Paper]
- CLRNet (Ours)

shahroztariq / CLRNet