Abstract:Since the human face preserves the richest information for recognizing individuals, face recognition has been widely investigated and achieved great success in various applications in the past decades. However, face spoofing attacks (e.g., face video replay attack) remain a threat to modern face recognition systems. Though many effective methods have been proposed for anti-spoofing, we find that the performance of many existing methods is degraded by illuminations. It motivates us to develop illumination-invariant methods for anti-spoofing. In this paper, we propose a two-stream convolutional neural network (TSCNN), which works on two complementary spaces: RGB space (original imaging space) and multi-scale retinex (MSR) space (illumination-invariant space). Specifically, the RGB space contains the detailed facial textures, yet it is sensitive to illumination; MSR is invariant to illumination, yet it contains less detailed facial information. In addition, the MSR images can effectively capture the high-frequency information, which is discriminative for face spoofing detection. Images from two spaces are fed to the TSCNN to learn the discriminative features for anti-spoofing. To effectively fuse the features from two sources (RGB and MSR), we propose an attention-based fusion method, which can effectively capture the complementarity of two features. We evaluate the proposed framework on various databases, i.e., CASIA-FASD, REPLAY-ATTACK, and OULU, and achieve very competitive performance. To further verify the generalization capacity of the proposed strategies, we conduct cross-database experiments, and the results show the great effectiveness of our method.

Dual Fusion Paired Environmental Background and Face Region for Face Anti-Spoofing

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Face Anti-Spoofing Via Jointly Modeling Local Texture and Constructed Depth

Face Liveness Detection by rPPG Features and Contextual Patch-Based CNN

A Neural Network Based on Supervised Multi-View Contrastive Learning and Two-Stage Feature Fusion for Face Anti-Spoofing

Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing

Face Anti-Spoofing with Human Material Perception

Unsupervised Face Anti-Spoofing Using Dual Cameras Based Feature Matching.

Dual-Cross Central Difference Network for Face Anti-Spoofing.

Attention-Based Two-Stream Convolutional Networks for Face Spoofing Detection

Face anti-spoofing with cross-stage relation enhancement and spoof material perception

Face anti-spoofing based on multi-modal and multi-scale features fusion

Multi-modal Face Anti-spoofing Using Channel Cross Fusion Network and Global Depth-Wise Convolution.

A Dual-Modal Face Anti-Spoofing Method via Light-Weight Networks

Two-stream Convolutional Networks for Multi-frame Face Anti-spoofing

Face Spoofing Detection Based on Multi-Scale Color Inversion Dual-Stream Convolutional Neural Network

Spoof-Guided Image Decomposition for Face Anti-spoofing.

Deep Spatial Gradient and Temporal Depth Learning for Face Anti-Spoofing

Static and Dynamic Fusion for Multi-modal Cross-ethnicity Face Anti-spoofing

Multi-modal Multi-layer Fusion Network with Average Binary Center Loss for Face Anti-spoofing

Face Anti-Spoofing by Fusing High and Low Frequency Features for Advanced Generalization Capability