Abstract:Real-world face recognition systems are vulnerable to diverse face attacks, ranging from digitally manipulated artifacts to physically crafted spoofing attacks. Existing works primarily focus on using an image classification network to address one type of attack but disregarding another. However, face recognition systems in real-world scenarios always encounter diverse simultaneous attacks, rendering the aforementioned single-attack detecting solution ineffective. Besides, excessive reliance on a classifier might easily fail when encountering face attacks with unknown patterns, as the category-level difference learned by classification backbones cannot generalize well to new attacks. Considering that real data are captured from actual individuals, while attack samples are generated by various distinct techniques, our focus is on extracting compact representations of real faces. This approach allows us to identify the fundamental differences between genuine and attack images, enabling us to address both manipulated artifacts and spoofing attacks simultaneously. Concretely, we propose a dual space reconstruction learning framework that models the commonalities of genuine faces in both spatial and frequency domains. With the learned characteristics of real faces, the model is more likely to segregate diverse attack samples as outliers from genuine images. Besides, we introduce a dynamic filtering module that filters out the redundant information retained by the reconstruction and enhances the critical divergence between the real and the attack to achieve better classification features. Since the training samples only cover limited style variations, which hampers the generalization to unseen domains, we further design a consistency regularized training strategy that mimics distribution shifts during training and imposes specific constraints to encourage style-irrelevant features. Moreover, in view of the lack of accessible benchmarks for unified evaluation of the detection competence against both face forgery and spoofing attacks, we set up a new challenging benchmark, named UniAttack, to foster the exploration of effective solutions to face attack detection. Both qualitative and quantitative results from existing and proposed benchmarks unequivocally demonstrate the superiority of our methods over state-of-the-art approaches.

Face Reconstruction Transfer Attack as Out-of-Distribution Generalization

Efficient and High-Quality Black-Box Face Reconstruction Attack.

Minimum Assumption Reconstruction Attacks: Rise of Security and Privacy Threats Against Face Recognition.

ReFace: Real-time Adversarial Attacks on Face Recognition Systems

Protecting Facial Privacy: Generating Adversarial Identity Masks via Style-robust Makeup Transfer

Transferable Adversarial Facial Images for Privacy Protection

Reconstruct Face from Features Using GAN Generator as a Distribution Constraint

Reconstruct Face from Features Based on Genetic Algorithm Using GAN Generator As a Distribution Constraint

Comprehensive Vulnerability Evaluation of Face Recognition Systems to Template Inversion Attacks Via 3D Face Reconstruction

Discrete Point-wise Attack is Not Enough: Generalized Manifold Adversarial Attack for Face Recognition

Enhancing the Transferability of Adversarial Attacks on Face Recognition with Diverse Parameters Augmentation

Black-box Attacks on Face Recognition Via Affine-Invariant Training

Generalized Attacks on Face Verification Systems

Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces

Improving Transferability of Adversarial Patches on Face Recognition with Generative Models

Inverting Gradient Attack Combined with GAN Network in Federated Learning of Face Recognition

Thinking in Patch: Towards Generalizable Forgery Detection with Patch Transformation

Attacks on State-of-the-Art Face Recognition using Attentional Adversarial Attack Generative Network

Towards Unified Defense for Face Forgery and Spoofing Attacks Via Dual Space Reconstruction Learning

NeRFTAP: Enhancing Transferability of Adversarial Patches on Face Recognition Using Neural Radiance Fields