Abstract:Face authentication technology has been widely used in physical access control to critical infrastructures. The security of a face authentication system has been threatened by photo replay attacks and thus the 3D liveness detection techniques have been deployed to safeguard such systems. In this paper, we conduct a comprehensive analysis of the security aspects pertaining to 3D liveness detection systems that employ structured light depth camera, and propose a novel attack surface targeting 3D face authentication systems involving multiple modalities such as Depth, RGB and IR. We propose the DepthFake attack, a multi-modal spoofing attack against real-world 3D face authentication using only a single 2D photo. To achieve it, DepthFake first reconstruct the depth information of the victim's face from his 2D photo. Then, DepthFake actively projects a carefully-crafted scatter patterns embedded with the face depth information, in order to empower the 2D photo with 3D authentication properties. We address a range of practical challenges, including mitigating depth estimation errors, achieving depth images forgery techniques based on structured light, ensuring accurate alignment between various modalities of face images, and effectively implementing DepthFake in real world. We validated DepthFake on 5 commercial face authentication systems (i.e., Tencent Cloud, Baidu Cloud, 3DiVi, Ali Cloud and ArcSoft) and two commercial access control devices. The results over 50 users demonstrate that DepthFake achieves an overall Depth attack success rate of $79.4\%$ , RGB-D attack success rate of $59.4\%$ , IR-D attack success rate of $79.4\%$ , and RGB-IR attack success rate of $83.8\%$ in the real world.

Polarized Image Translation from Nonpolarized Cameras for Multimodal Face Anti-Spoofing.

Face Anti-Spoofing by Learning Polarization Cues in a Real-World Scenario

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

Asymmetric Modality Translation For Face Presentation Attack Detection

Synthesis of High-Quality Visible Faces from Polarimetric Thermal Faces using Generative Adversarial Networks

Multi-modal Spoofing Attacks on 3D Face Liveness Detection Via a Single 2D Photo

A 3D Mask Presentation Attack Detection Method Based on Polarization Medium Wave Infrared Imaging

A Dual-Modal Face Anti-Spoofing Method via Light-Weight Networks

Face Liveness Detection by rPPG Features and Contextual Patch-Based CNN

Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Faces

Suppress and Rebalance: Towards Generalized Multi-Modal Face Anti-Spoofing

Static and Dynamic Fusion for Multi-modal Cross-ethnicity Face Anti-spoofing

Polarimetric Thermal to Visible Face Verification via Attribute Preserved Synthesis

An Effective Face Anti-Spoofing Method via Stereo Matching

Dual Fusion Paired Environmental Background and Face Region for Face Anti-Spoofing

Enhancing Polarization 3D Facial Imaging: Overcoming Azimuth Ambiguity Without Extra Depth Devices.

Spoof-Guided Image Decomposition for Face Anti-spoofing.

3D Face Anti-Spoofing With Factorized Bilinear Coding

Mfad: A Multi-Modality Face Anti-Spoofing Dataset

Deep Spatial Gradient and Temporal Depth Learning for Face Anti-Spoofing

Polarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesis