Abstract:Real-world face recognition systems are vulnerable to diverse face attacks, ranging from digitally manipulated artifacts to physically crafted spoofing attacks. Existing works primarily focus on using an image classification network to address one type of attack but disregarding another. However, face recognition systems in real-world scenarios always encounter diverse simultaneous attacks, rendering the aforementioned single-attack detecting solution ineffective. Besides, excessive reliance on a classifier might easily fail when encountering face attacks with unknown patterns, as the category-level difference learned by classification backbones cannot generalize well to new attacks. Considering that real data are captured from actual individuals, while attack samples are generated by various distinct techniques, our focus is on extracting compact representations of real faces. This approach allows us to identify the fundamental differences between genuine and attack images, enabling us to address both manipulated artifacts and spoofing attacks simultaneously. Concretely, we propose a dual space reconstruction learning framework that models the commonalities of genuine faces in both spatial and frequency domains. With the learned characteristics of real faces, the model is more likely to segregate diverse attack samples as outliers from genuine images. Besides, we introduce a dynamic filtering module that filters out the redundant information retained by the reconstruction and enhances the critical divergence between the real and the attack to achieve better classification features. Since the training samples only cover limited style variations, which hampers the generalization to unseen domains, we further design a consistency regularized training strategy that mimics distribution shifts during training and imposes specific constraints to encourage style-irrelevant features. Moreover, in view of the lack of accessible benchmarks for unified evaluation of the detection competence against both face forgery and spoofing attacks, we set up a new challenging benchmark, named UniAttack, to foster the exploration of effective solutions to face attack detection. Both qualitative and quantitative results from existing and proposed benchmarks unequivocally demonstrate the superiority of our methods over state-of-the-art approaches.

Disentangled Representation based Face Anti-Spoofing

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Disentangle Irrelevant and Critical Representations for Face Anti-Spoofing

Physics-Guided Spoof Trace Disentanglement for Generic Face Anti-Spoofing

Learning Polysemantic Spoof Trace: A Multi-Modal Disentanglement Network for Face Anti-spoofing

Spoof Trace Disentanglement for Generic Face Anti-Spoofing

Deep Learning for Face Anti-Spoofing: A Survey

Face Anti-Spoofing: Model Matters, So Does Data

Multi-level feature disentanglement network for cross-dataset face forgery detection

Dual feature disentanglement for face anti-spoofing

Deep Ensemble Learning with Frame Skipping for Face Anti-Spoofing

Face Anti-spoofing Based on Cooperative Pose Analysis.

Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing

An Effective Face Anti-Spoofing Method via Stereo Matching

Two-stream Convolutional Networks for Multi-frame Face Anti-spoofing

Deep Spatial Gradient and Temporal Depth Learning for Face Anti-Spoofing

Face De-Spoofing: Anti-Spoofing via Noise Modeling

Learning Inter and Intra Class Variation with Deep Frequency Factorization Network for Face Anti-Spoofing

Towards Unified Defense for Face Forgery and Spoofing Attacks Via Dual Space Reconstruction Learning

A Multi-Modal Approach for Face Anti-Spoofing in Non-Calibrated Systems using Disparity Maps

Dynamic Residual Distillation Network for Face Anti-Spoofing with Feature Attention Learning