Abstract:Face authentication technology has been widely used in physical access control to critical infrastructures. The security of a face authentication system has been threatened by photo replay attacks and thus the 3D liveness detection techniques have been deployed to safeguard such systems. In this paper, we conduct a comprehensive analysis of the security aspects pertaining to 3D liveness detection systems that employ structured light depth camera, and propose a novel attack surface targeting 3D face authentication systems involving multiple modalities such as Depth, RGB and IR. We propose the DepthFake attack, a multi-modal spoofing attack against real-world 3D face authentication using only a single 2D photo. To achieve it, DepthFake first reconstruct the depth information of the victim's face from his 2D photo. Then, DepthFake actively projects a carefully-crafted scatter patterns embedded with the face depth information, in order to empower the 2D photo with 3D authentication properties. We address a range of practical challenges, including mitigating depth estimation errors, achieving depth images forgery techniques based on structured light, ensuring accurate alignment between various modalities of face images, and effectively implementing DepthFake in real world. We validated DepthFake on 5 commercial face authentication systems (i.e., Tencent Cloud, Baidu Cloud, 3DiVi, Ali Cloud and ArcSoft) and two commercial access control devices. The results over 50 users demonstrate that DepthFake achieves an overall Depth attack success rate of $79.4\%$ , RGB-D attack success rate of $59.4\%$ , IR-D attack success rate of $79.4\%$ , and RGB-IR attack success rate of $83.8\%$ in the real world.

Three-dimensional Image Authentication with Double Random Phase Encryption in One Capture.

DepthFake: Spoofing 3D Face Authentication with a 2D Photo

Three-dimensional image authentication from multi-view images

Multi-modal Spoofing Attacks on 3D Face Liveness Detection Via a Single 2D Photo

Encoded-image-based authentication utilizing diffractive-imaging scheme and secret-key-assisted phase retrieval

Three-Dimensional Single Random Phase Encryption

Three-Dimensional Double Random-Phase Encryption for Simultaneous Two-Primary Data

Image Encryption Based on Double Random Phase Encoding.

A Double Color Image Encryption Scheme Based on Three-Dimensional Brownian Motion

Recognizing three-dimensional phase images with deep learning

Single‐Shot Recognition of 3D Phase Images with Deep Learning

Optical image encryption based on 3D double-phase encoding algorithm in the gyrator transform domain

Exploiting Compressed Sensing and Polynomial-Based Progressive Secret Image Sharing for Visually Secure Image Selection Encryption with Authentication

Encryption and volumetric 3D object reconstruction using multispectral computational integral imaging.

A Three-Dimensional Optical Image Cryptosystem Based on Integral Imaging.

Multiple-image authentication method based on phase-only holograms and a logistic map

3D medical images security via light-field imaging

Double optical image encryption system based on near-field Fourier ptychography

Optical image transformation and encryption by phase-retrieval-based double random-phase encoding and compressive ghost imaging

Optical image encryption based on two-channel detection and deep learning

Double images encryption method with resistance against the specific attack based on an asymmetric algorithm.