Abstract:Face anti-spoofing (FAS) is essential for securing face recognition systems. Despite the decent performance, few existing works fully leverage temporal information. This would inevitably lead to inferior performance because real and fake faces tend to share highly similar spatial appearances, while important temporal features between consecutive frames are neglected. In this work, we propose a temporal transformer network (TTN) to learn multi-granularity temporal characteristics for FAS. It mainly consists of temporal difference attentions (TDA), a pyramid temporal aggregation (PTA), and a temporal depth difference loss (TDL). Firstly, the vision transformer (ViT) is used as the backbone where comprehensive local patches are utilized to provide subtle differences between live and spoof faces. Then, instead of learning temporal features on global faces which may miss some important local cues, the TDA is developed to extract motion-sensitive cues on each of the comprehensive local patches. Moreover, the TDA is inserted into different layers of the ViT, learning multi-scale motion-sensitive local cues to improve the FAS performance. Secondly, it is observed that different subjects may have different visual tempos in some actions, making it necessary to model different temporal speeds. Our PTA aggregates temporal features at various tempos, which could build short-range and long-range relations among multiple frames. Thirdly, depth maps for real parts may change continuously, while they remain zeros for spoof regions. In order to locate motion features on facial parts, the TDL is proposed to guide the network to locate spoof facial parts where motion patterns between neighboring frames are set as the ground truth. To the best of our knowledge, this work is the first attempt to learn temporal characteristics via transformers. Both qualitative and quantitative results on several challenging tasks demonstrate the usefulness and effectiveness of our proposed methods.

Attention-Based Spatial-Temporal Multi-Scale Network for Face Anti-Spoofing

Selective Domain-Invariant Feature Alignment Network for Face Anti-Spoofing.

Deep Frequent Spatial Temporal Learning for Face Anti-Spoofing

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing

Deep Spatial Gradient and Temporal Depth Learning for Face Anti-Spoofing

Face anti-spoofing with cross-stage relation enhancement and spoof material perception

Learning Multi-Granularity Temporal Characteristics for Face Anti-Spoofing

Two-stream Convolutional Networks for Multi-frame Face Anti-spoofing

Deep Learning for Face Anti-Spoofing: A Survey

Learning Inter and Intra Class Variation with Deep Frequency Factorization Network for Face Anti-Spoofing

Face Anti-Spoofing with Human Material Perception

Multi-Frames Temporal Abnormal Clues Learning Method for Face Anti-Spoofing

Dual-Cross Central Difference Network for Face Anti-Spoofing.

FGDNet: Fine-Grained Detection Network Towards Face Anti-Spoofing

Attention-Based Two-Stream Convolutional Networks for Face Spoofing Detection

Face Anti-Spoofing: Model Matters, So Does Data

Combined spatial and frequency dual stream network for face forgery detection

Face Liveness Detection by rPPG Features and Contextual Patch-Based CNN

Multi-modal Face Anti-spoofing Using Channel Cross Fusion Network and Global Depth-Wise Convolution.