Abstract:Deepfake data contains realistically manipulated faces—its abuses pose a huge threat to the security and privacy-critical applications. Intensive research from academia and industry has produced many deepfake/detection models, leading to a constant race of attack and defense. However, due to the lack of a unified evaluation platform, many critical questions on this subject remain largely unexplored. How is the anti-detection ability of the existing deepfake models? How generalizable are existing detection models against different deepfake samples? How effective are the detection APIs provided by the cloud-based vendors? How evasive and transferable are adversarial deepfakes in the lab and real-world environment? How do various factors impact the performance of deepfake and detection models? To bridge the gap, we design and implement DEEPFAKER 1 a unified and comprehensive deepfake detection evaluation platform. Specifically, DEEPFAKER has integrated 10 state-of-the-art deepfake methods and 9 representative detection methods, while providing a user-friendly interface and modular design that allows for easy integration of new methods. Leveraging DEEPFAKER , we conduct a large-scale empirical study of facial deepfake/detection models and draw a set of key findings: (i) the detection methods have poor generalization on samples generated by different deepfake methods; (ii) there is no significant correlation between anti-detection ability and visual quality of deepfake samples; (iii) the current detection APIs have poor detection performance and adversarial deepfakes can achieve about 70% attack success rate on all cloud-based vendors, calling for an urgent need to deploy effective and robust detection APIs; (iv) the detection methods in the lab are more robust against transfer attacks than the detection APIs in the real-world environment; and (v) deepfake videos may not always be more difficult to detect after video compression. We envision that DEEPFAKER will benefit future research on facial deepfake and detection.

Fawkes: Protecting Privacy against Unauthorized Deep Learning Models

Transferable Adversarial Facial Images for Privacy Protection

RFace: Anti-Spoofing Facial Authentication Using COTS RFID

Deepfake Detection with Data Privacy Protection

PuFace: Defending against Facial Cloaking Attacks for Facial Recognition Models

Personalized Privacy Protection Mask Against Unauthorized Facial Recognition

Anti-Fake Vaccine: Safeguarding Privacy Against Face Swapping Via Visual-Semantic Dual Degradation

Makeup-Guided Facial Privacy Protection via Untrained Neural Network Priors

Building an Invisible Shield for Your Portrait against Deepfakes

ErasableMask: A Robust and Erasable Privacy Protection Scheme against Black-box Face Recognition Models

LowKey: Leveraging Adversarial Attacks to Protect Social Media Users from Facial Recognition

FaceShield: Defending Facial Image against Deepfake Threats

Targeted Anonymization: A Face Image Anonymization Method for Unauthorized Models

CLIP2Protect: Protecting Facial Privacy using Text-Guided Makeup via Adversarial Latent Search

Enhancing Mobile Privacy and Security: A Face Skin Patch-Based Anti-Spoofing Approach

AdvFAS: A robust face anti-spoofing framework against adversarial examples

AdvCloak: Customized Adversarial Cloak for Privacy Protection

Hidden Data Privacy Breaches in Federated Learning

DEEPFAKER: A Unified Evaluation Platform for Facial Deepfake and Detection Models

FASS: Face Anti-Spoofing System Using Image Quality Features and Deep Learning

Securing Facial Bioinformation by Eliminating Adversarial Perturbations