Abstract:Deepfakes utilise Artificial Intelligence (AI) techniques to create synthetic media where the likeness of one person is replaced with another. There are growing concerns that deepfakes can be maliciously used to create misleading and harmful digital contents. As deepfakes become more common, there is a dire need for deepfake detection technology to help spot deepfake media. Present deepfake detection models are able to achieve outstanding accuracy (>90%). However, most of them are limited to within-dataset scenario, where the same dataset is used for training and testing. Most models do not generalise well enough in cross-dataset scenario, where models are tested on unseen datasets from another source. Furthermore, state-of-the-art deepfake detection models rely on neural network-based classification models that are known to be vulnerable to adversarial attacks. Motivated by the need for a robust deepfake detection model, this study adapts metamorphic testing (MT) principles to help identify potential factors that could influence the robustness of the examined model, while overcoming the test oracle problem in this domain. Metamorphic testing is specifically chosen as the testing technique as it fits our demand to address learning-based system testing with probabilistic outcomes from largely black-box components, based on potentially large input domains. We performed our evaluations on MesoInception-4 and TwoStreamNet models, which are the state-of-the-art deepfake detection models. This study identified makeup application as an adversarial attack that could fool deepfake detectors. Our experimental results demonstrate that both the MesoInception-4 and TwoStreamNet models degrade in their performance by up to 30\% when the input data is perturbed with makeup.

Towards robust DeepFake distortion attack via adversarial autoaugment

Restricted Black-Box Adversarial Attack Against DeepFake Face Swapping

Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Faces

Adversarial Threats to DeepFake Detection: A Practical Perspective

Adversarial Robust Safeguard for Evading Deep Facial Manipulation

Deepfake Forensics Via an Adversarial Game

Crafting imperceptible and transferable adversarial examples: leveraging conditional residual generator and wavelet transforms to deceive deepfake detection

Evading DeepFake Detectors via Adversarial Statistical Consistency

Mitigating Adversarial Attacks in Deepfake Detection: An Exploration of Perturbation and AI Techniques

Robust Attacks on Deep Learning Face Recognition in the Physical World

Hiding Faces in Plain Sight: Defending DeepFakes by Disrupting Face Detection

Adversarial Deepfakes: Evaluating Vulnerability of Deepfake Detectors to Adversarial Examples

A New Approach to Improve Learning-based Deepfake Detection in Realistic Conditions

Artifacts-Disentangled Adversarial Learning for Deepfake Detection

Feature Extraction Matters More: An Effective and Efficient Universal Deepfake Disruptor

GreedyFool: Distortion-Aware Sparse Adversarial Attack

Jointly Defending DeepFake Manipulation and Adversarial Attack Using Decoy Mechanism

MagDR: Mask-guided Detection and Reconstruction for Defending Deepfakes

Anti-Forensics for Face Swapping Videos via Adversarial Training

Metamorphic Testing-based Adversarial Attack to Fool Deepfake Detectors

Real is not True: Backdoor Attacks Against Deepfake Detection