Abstract:Deepfake data contains realistically manipulated faces—its abuses pose a huge threat to the security and privacy-critical applications. Intensive research from academia and industry has produced many deepfake/detection models, leading to a constant race of attack and defense. However, due to the lack of a unified evaluation platform, many critical questions on this subject remain largely unexplored. How is the anti-detection ability of the existing deepfake models? How generalizable are existing detection models against different deepfake samples? How effective are the detection APIs provided by the cloud-based vendors? How evasive and transferable are adversarial deepfakes in the lab and real-world environment? How do various factors impact the performance of deepfake and detection models? To bridge the gap, we design and implement DEEPFAKER 1 a unified and comprehensive deepfake detection evaluation platform. Specifically, DEEPFAKER has integrated 10 state-of-the-art deepfake methods and 9 representative detection methods, while providing a user-friendly interface and modular design that allows for easy integration of new methods. Leveraging DEEPFAKER , we conduct a large-scale empirical study of facial deepfake/detection models and draw a set of key findings: (i) the detection methods have poor generalization on samples generated by different deepfake methods; (ii) there is no significant correlation between anti-detection ability and visual quality of deepfake samples; (iii) the current detection APIs have poor detection performance and adversarial deepfakes can achieve about 70% attack success rate on all cloud-based vendors, calling for an urgent need to deploy effective and robust detection APIs; (iv) the detection methods in the lab are more robust against transfer attacks than the detection APIs in the real-world environment; and (v) deepfake videos may not always be more difficult to detect after video compression. We envision that DEEPFAKER will benefit future research on facial deepfake and detection.

4DPM: Deepfake Detection with a Denoising Diffusion Probabilistic Mask

Hierarchical Supervisions with Two-Stream Network for Deepfake Detection.

Masked Conditional Diffusion Model for Enhancing Deepfake Detection

Noise-aware progressive multi-scale deepfake detection

Unmasking DeepFakes with simple Features

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

Patch-DFD: Patch-based end-to-end DeepFake discriminator

Noise Based Deepfake Detection via Multi-Head Relative-Interaction

FFR_FD: Effective and Fast Detection of DeepFakes Based on Feature Point Defects

Multi-attentional Deepfake Detection

Deepfake Detection for Facial Images with Facemasks

FFR_FD: Effective and fast detection of DeepFakes via feature point defects

DiffusionFake: Enhancing Generalization in Deepfake Detection via Guided Stable Diffusion

MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detection

DA-FDFtNet: Dual Attention Fake Detection Fine-tuning Network to Detect Various AI-Generated Fake Images

MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakes

Mastering Deepfake Detection: A Cutting-Edge Approach to Distinguish GAN and Diffusion-Model Images

Learning a Deep Dual-Level Network for Robust DeepFake Detection

Unmasking Deepfake Faces from Videos Using An Explainable Cost-Sensitive Deep Learning Approach

DEEPFAKER: A Unified Evaluation Platform for Facial Deepfake and Detection Models