Abstract:Real-world face recognition systems are vulnerable to diverse face attacks, ranging from digitally manipulated artifacts to physically crafted spoofing attacks. Existing works primarily focus on using an image classification network to address one type of attack but disregarding another. However, face recognition systems in real-world scenarios always encounter diverse simultaneous attacks, rendering the aforementioned single-attack detecting solution ineffective. Besides, excessive reliance on a classifier might easily fail when encountering face attacks with unknown patterns, as the category-level difference learned by classification backbones cannot generalize well to new attacks. Considering that real data are captured from actual individuals, while attack samples are generated by various distinct techniques, our focus is on extracting compact representations of real faces. This approach allows us to identify the fundamental differences between genuine and attack images, enabling us to address both manipulated artifacts and spoofing attacks simultaneously. Concretely, we propose a dual space reconstruction learning framework that models the commonalities of genuine faces in both spatial and frequency domains. With the learned characteristics of real faces, the model is more likely to segregate diverse attack samples as outliers from genuine images. Besides, we introduce a dynamic filtering module that filters out the redundant information retained by the reconstruction and enhances the critical divergence between the real and the attack to achieve better classification features. Since the training samples only cover limited style variations, which hampers the generalization to unseen domains, we further design a consistency regularized training strategy that mimics distribution shifts during training and imposes specific constraints to encourage style-irrelevant features. Moreover, in view of the lack of accessible benchmarks for unified evaluation of the detection competence against both face forgery and spoofing attacks, we set up a new challenging benchmark, named UniAttack, to foster the exploration of effective solutions to face attack detection. Both qualitative and quantitative results from existing and proposed benchmarks unequivocally demonstrate the superiority of our methods over state-of-the-art approaches.

UCDCN: a Nested Architecture Based on Central Difference Convolution for Face Anti-Spoofing

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Selective Domain-Invariant Feature Alignment Network for Face Anti-Spoofing.

Dual-Cross Central Difference Network for Face Anti-Spoofing.

Searching Central Difference Convolutional Networks for Face Anti-Spoofing

Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing

Multi-Modal Face Anti-Spoofing Based on Central Difference Networks

Multi-modal Face Anti-spoofing Using Channel Cross Fusion Network and Global Depth-Wise Convolution.

Two-stream Convolutional Networks for Multi-frame Face Anti-spoofing

Face Liveness Detection by rPPG Features and Contextual Patch-Based CNN

Attention-Based Two-Stream Convolutional Networks for Face Spoofing Detection

Face anti-spoofing with cross-stage relation enhancement and spoof material perception

Towards Unified Defense for Face Forgery and Spoofing Attacks Via Dual Space Reconstruction Learning

A Performance Evaluation of Convolutional Neural Networks for Face Anti Spoofing

Face anti-spoofing using patch and depth-based CNNs

Learn Convolutional Neural Network for Face Anti-Spoofing

FGDNet: Fine-Grained Detection Network Towards Face Anti-Spoofing

Face anti-spoofing algorithm combined with CNN and brightness equalization

Face Anti-Spoofing by Fusing High and Low Frequency Features for Advanced Generalization Capability

Multi-modal Face Anti-spoofing Using Multi-fusion Network and Global Depth-wise Convolution