Abstract:Face presentation attacks (FPA), also known as face spoofing, have brought increasing concerns to the public through various malicious applications, such as financial fraud and privacy leakage. Therefore, safeguarding face recognition systems against FPA is of utmost importance. Although existing learning-based face anti-spoofing (FAS) models can achieve outstanding detection performance, they lack generalization capability and suffer significant performance drops in unforeseen environments. Many methodologies seek to use auxiliary modality data (e.g., depth and infrared maps) during the presentation attack detection (PAD) to address this limitation. However, these methods can be limited since (1) they require specific sensors such as depth and infrared cameras for data capture, which are rarely available on commodity mobile devices, and (2) they cannot work properly in practical scenarios when either modality is missing or of poor quality. In this paper, we devise an accurate and robust MultiModal Mobile Face Anti-Spoofing system named M3FAS to overcome the issues above. The primary innovation of this work lies in the following aspects: (1) To achieve robust PAD, our system combines visual and auditory modalities using three commonly available sensors: camera, speaker, and microphone; (2) We design a novel two-branch neural network with three hierarchical feature aggregation modules to perform cross-modal feature fusion; (3). We propose a multi-head training strategy, allowing the model to output predictions from the vision, acoustic, and fusion heads, resulting in a more flexible PAD. Extensive experiments have demonstrated the accuracy, robustness, and flexibility of M3FAS under various challenging experimental settings. The source code and dataset are available at: <a class="link-external link-https" href="https://github.com/ChenqiKONG/M3FAS/" rel="external noopener nofollow">this https URL</a>

Face presentation attack detection based on optical flow and texture analysis

A Real-Time Detection Approach Against Video-Replay Attack in Face Recognition

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Face Liveness Detection by rPPG Features and Contextual Patch-Based CNN

Improved Detection of Face Presentation Attacks Using Image Decomposition

Multi-modal Spoofing Attacks on 3D Face Liveness Detection Via a Single 2D Photo

Mask Attack Detection Using Vascular-weighted Motion-robust rPPG Signals

Face Presentation Attack Detection in Learned Color-liked Space

CompactNet: learning a compact space for face presentation attack detection

Generalized face anti-spoofing by detecting pulse from face videos

Enhance the Motion Cues for Face Anti-Spoofing using CNN-LSTM Architecture

Can Your Face Detector Do Anti-spoofing? Face Presentation Attack Detection with a Multi-Channel Face Detector

3D Face Mask Presentation Attack Detection Based on Intrinsic Image Analysis

PAD-Phys: Exploiting Physiology for Presentation Attack Detection in Face Biometrics

Boosting Face Presentation Attack Detection in Multi-Spectral Videos Through Score Fusion of Wavelet Partition Images

Asymmetric Modality Translation For Face Presentation Attack Detection

M3FAS: An Accurate and Robust MultiModal Mobile Face Anti-Spoofing System

Presentation Attack Detection with Advanced CNN Models for Noncontact-based Fingerprint Systems

Face Presentation Attack Detection Using Deep Background Subtraction

Presentation Attack Face Image Generation Based on a Deep Generative Adversarial Network

CLIPC8: Face liveness detection algorithm based on image-text pairs and contrastive learning