Abstract:Face Recognition is a widely used authentication method deployed for accessing personal digital devices like mobiles and laptops, digital door locks, or various security applications. However, presentation attacks in form of print, video and mask can circumvent such authentication methods. Several solutions based on texture features are proposed in the state-of-the-art; nevertheless, they are sensitive to varying illumination conditions and are less resilient against 2D and 3D attacks. In this paper, we propose a novel 3-stream compact Xception framework (3sXcsNet) consisting of four input streams RGB, MSRCR, MSRCP, and a depth map to form two specific 3-stream fusion (CRF and CPF) to mitigate the illumination scenarios. These streams provide discriminative features. RGB images have rich texture features; MSRCR and MSRCP images are illumination invariant and preserve better chromaticity applied on a color or intensity channel, respectively. In addition, an auxiliary depth map that provides depth information for each pixel makes it easier to analyze features and recognize whether the input image is from a real person or a spoof medium. The 3-stream CRF and CPF represent the features differently and feed independently to a deep CNN compact Xception with a CBAM network. These feature maps are fused using an average fusion mechanism for classification of real and spoof faces. We utilize both 2D and 3D attack datasets namely, REPLAY-ATTACK, CASIA-FASD, OULU-NPU, and 3DMAD to evaluate the effectiveness of the proposed framework. We attain an EER of 1.27% and 0.19% for CRF fusion, as well as 1.48% and 0.20% for CPF fusion when assessing performance on the CASIA-FASD and REPLAY-ATTACK datasets, respectively. On the OULU-NPU dataset, we obtain the most favorable results for two protocols while employing CRF fusion, resulting in ACER metrics of 0.7% and 3.2±2.7%, respectively. On the other hand, CPF fusion outperformed with an ACER of 1.8±1.0% for one protocol. Our findings on intra-database outperform the current state-of-the-art. We also perform cross-database testing to assess the generalization capability of the framework on 2D and 3D attack datasets. Furthermore, the proposed method outperforms both fusion procedures in terms of error rate HTER for intra-database and cross-database testing on the 3DMAD dataset.

Deep Secure Encoding: An Application to Face Recognition

Maximum Entropy Binary Encoding for Face Template Protection

A Secure Face-Verification Scheme Based on Homomorphic Encryption and Deep Neural Networks.

Deep Face Fuzzy Vault: Implementation and Performance

Face Template Protection Using Deep LDPC Codes Learning

BioDeepHash: Mapping Biometrics into a Stable Code

Face Template Protection through Residual Learning Based Error-Correcting Codes.

DEEP TEXTURE FEATURES FOR ROBUST FACE SPOOFING DETECTION

A Machine Learning-Based Secure Face Verification Scheme and Its Applications to Digital Surveillance

Enhanced Biometric Template Protection Schemes for Securing Face Recognition in IoT Environment

Enhancing Privacy in Face Analytics Using Fully Homomorphic Encryption

A Deep, Information-theoretic Framework for Robust Biometric Recognition

Face Authentication using MTCNN and FaceNet

A Novel Scheme for Generating Secure Face Templates Using BDA

Private‐encoder: Enforcing Privacy in Latent Space for Human Face Images

Deep Learning in the Field of Biometric Template Protection: An Overview

Impact of computer vision based secure image enrichment techniques on image classification model

Secure Dual Network for Reversible Facial Image Anonymization Through the Latent Space Manipulation

Deep Hashing Based Cancelable Multi-biometric Template Protection

A Robust Algorithm Of Encrypted Face Recognition Based On Dwt-Dct And Tent Map

3sXcsNet: A framework for face presentation attack detection using deep learning