Abstract:The non-consensual exploitation of facial manipulation has emerged as a pressing societal concern. In tandem with the identification of such fake content, recent research endeavors have advocated countering manipulation techniques through proactive interventions, specifically the incorporation of adversarial noise to impede the manipulation in advance. Nevertheless, with insufficient consideration of robustness, we show that current methods falter in providing protection after simple perturbations, e.g., blur. In addition, traditional optimization-based methods face limitations in scalability as they struggle to accommodate the substantial expansion of data volume, a consequence of the time-intensive iterative pipeline. To solve these challenges, we propose a learning-based model, Adversarial Robust Safeguard (ARS), to generate desirable protection noise in a single forward process, concurrently exhibiting a heightened resistance against prevalent perturbations. Specifically, our method involves a two-way protection design, characterized by a basic protection component responsible for generating efficacious noise features, coupled with robust protection for further enhancement. In robust protection, we first fuse image features with spatially duplicated noise embedding, thereby accounting for inherent information redundancy. Subsequently, a combination comprising a differentiable perturbation module and an adversarial network is devised to simulate potential information degradation during the training process. To evaluate it, we conduct experiments on four manipulation methods and compare recent works comprehensively. The results of our method exhibit good visual effects with pronounced robustness against varied perturbations at different levels.

MaGAT: Mask-Guided Adversarial Training for Defending Face Editing GAN Models From Proactive Defense

NetGuard: Protecting Commercial Web APIs from Model Inversion Attacks Using GAN-generated Fake Samples

A GAN-Based Defense Framework Against Model Inversion Attacks.

UnGANable: Defending Against GAN-based Face Manipulation

Defense-GAN: Protecting Classifiers Against Adversarial Attacks Using Generative Models

Defending against GAN-based Deepfake Attacks via Transformation-aware Adversarial Faces

Evaluation of GAN-Based Model for Adversarial Training

Initiative Defense against Facial Manipulation

HAD-GAN: A Human-perception Auxiliary Defense GAN to Defend Adversarial Examples

GanDef: A GAN based Adversarial Training Defense for Neural Network Classifier

GAN-based Classifier Protection Against Adversarial Attacks

APE-GAN: Adversarial Perturbation Elimination with GAN.

Adversarial Robust Safeguard for Evading Deep Facial Manipulation

MaskFaceGAN: High-Resolution Face Editing With Masked GAN Latent Code Optimization

Detecting Adversarial Faces Using Only Real Face Self-Perturbations

3D-Aware Adversarial Makeup Generation for Facial Privacy Protection

OGAN: Disrupting Deepfakes with an Adversarial Attack that Survives Training

Mask-Guided Portrait Editing With Conditional GANs

Real-World Adversarial Examples Via Makeup

Imperceptible Face Forgery Attack via Adversarial Semantic Mask

GRIP-GAN: an Attack-Free Defense Through General Robust Inverse Perturbation