Abstract:Face authentication technology has been widely used in physical access control to critical infrastructures. The security of a face authentication system has been threatened by photo replay attacks and thus the 3D liveness detection techniques have been deployed to safeguard such systems. In this paper, we conduct a comprehensive analysis of the security aspects pertaining to 3D liveness detection systems that employ structured light depth camera, and propose a novel attack surface targeting 3D face authentication systems involving multiple modalities such as Depth, RGB and IR. We propose the DepthFake attack, a multi-modal spoofing attack against real-world 3D face authentication using only a single 2D photo. To achieve it, DepthFake first reconstruct the depth information of the victim's face from his 2D photo. Then, DepthFake actively projects a carefully-crafted scatter patterns embedded with the face depth information, in order to empower the 2D photo with 3D authentication properties. We address a range of practical challenges, including mitigating depth estimation errors, achieving depth images forgery techniques based on structured light, ensuring accurate alignment between various modalities of face images, and effectively implementing DepthFake in real world. We validated DepthFake on 5 commercial face authentication systems (i.e., Tencent Cloud, Baidu Cloud, 3DiVi, Ali Cloud and ArcSoft) and two commercial access control devices. The results over 50 users demonstrate that DepthFake achieves an overall Depth attack success rate of $79.4\%$ , RGB-D attack success rate of $59.4\%$ , IR-D attack success rate of $79.4\%$ , and RGB-IR attack success rate of $83.8\%$ in the real world.

Detection of Video-Based Face Spoofing Using LBP and Multiscale DCT

LBP and Multilayer DCT Based Anti-Spoofing Countermeasure in Face Liveness Detection

Face Anti-Spoofing Detection Based on DWT-LBP-DCT Features

A Cascade Face Spoofing Detector Based on Face Anti-Spoofing R-CNN and Improved Retinex LBP

A Real-Time Detection Approach Against Video-Replay Attack in Face Recognition

Image Analysis of Facial Blood Vessels for Anti-Spoofing of Printed Image and 3D Mask Attacks

Face spoofing detection based on chromatic ED-LBP texture feature

Face Anti-Spoofing Via Jointly Modeling Local Texture and Constructed Depth

Face Liveness Detection by rPPG Features and Contextual Patch-Based CNN

CNN Based Spatio-Temporal Feature Extraction for Face Anti-Spoofing

Face Spoofing Detection by Fusing Binocular Depth and Spatial Pyramid Coding Micro-Texture Features

Face Anti-Spoofing System using Motion and Similarity Feature Elimination under Spoof Attacks

Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing

Face Spoofing Detection with Local Binary Pattern Network

Generalized face anti-spoofing by detecting pulse from face videos

Multi-modal Spoofing Attacks on 3D Face Liveness Detection Via a Single 2D Photo

A Color-Texture-Based Deep Neural Network Technique to Detect Face Spoofing Attacks

Attention-Based Two-Stream Convolutional Networks for Face Spoofing Detection

Face Anti-Spoofing Based on Dynamic Color Texture Analysis Using Local Directional Number Pattern.

Investigation in Spatial-Temporal Domain for Face Spoof Detection

Face anti-spoofing using patch and depth-based CNNs