Abstract:Deepfake data contains realistically manipulated faces—its abuses pose a huge threat to the security and privacy-critical applications. Intensive research from academia and industry has produced many deepfake/detection models, leading to a constant race of attack and defense. However, due to the lack of a unified evaluation platform, many critical questions on this subject remain largely unexplored. How is the anti-detection ability of the existing deepfake models? How generalizable are existing detection models against different deepfake samples? How effective are the detection APIs provided by the cloud-based vendors? How evasive and transferable are adversarial deepfakes in the lab and real-world environment? How do various factors impact the performance of deepfake and detection models? To bridge the gap, we design and implement DEEPFAKER 1 a unified and comprehensive deepfake detection evaluation platform. Specifically, DEEPFAKER has integrated 10 state-of-the-art deepfake methods and 9 representative detection methods, while providing a user-friendly interface and modular design that allows for easy integration of new methods. Leveraging DEEPFAKER , we conduct a large-scale empirical study of facial deepfake/detection models and draw a set of key findings: (i) the detection methods have poor generalization on samples generated by different deepfake methods; (ii) there is no significant correlation between anti-detection ability and visual quality of deepfake samples; (iii) the current detection APIs have poor detection performance and adversarial deepfakes can achieve about 70% attack success rate on all cloud-based vendors, calling for an urgent need to deploy effective and robust detection APIs; (iv) the detection methods in the lab are more robust against transfer attacks than the detection APIs in the real-world environment; and (v) deepfake videos may not always be more difficult to detect after video compression. We envision that DEEPFAKER will benefit future research on facial deepfake and detection.

Accurate and Time-saving Deepfake Detection in Multi-face Scenarios Using Combined Features.

Multi-feature fusion based face forgery detection with local and global characteristics

Exploiting Facial Relationships and Feature Aggregation for Multi-Face Forgery Detection

Multi-attentional Deepfake Detection

Refining Localized Attention Features with Multi-Scale Relationships for Enhanced Deepfake Detection in Spatial-Frequency Domain

Unmasking DeepFakes with simple Features

Deepfake detection in videos with multiple faces using geometric-fakeness features

A survey on face forgery detection of Deepfake

FFR_FD: Effective and fast detection of DeepFakes via feature point defects

DeepFake detection method based on multi-scale interactive dual-stream network

GM-DF: Generalized Multi-Scenario Deepfake Detection

DEEPFAKER: A Unified Evaluation Platform for Facial Deepfake and Detection Models

Multiple Contexts and Frequencies Aggregation Network forDeepfake Detection

Comparison of Deepfake Detection Techniques through Deep Learning

Deepfake Detection for Facial Images with Facemasks

Common Forgery Artifact Driven Deepfake Face Detection

Deepfake Video Detection Using Facial Feature Points and Ch-Transformer

Individualized Deepfake Detection Exploiting Traces Due to Double Neural-Network Operations

FFR_FD: Effective and Fast Detection of DeepFakes Based on Feature Point Defects

Deepfake detection: Enhancing performance with spatiotemporal texture and deep learning feature fusion

UniForensics: Face Forgery Detection via General Facial Representation