Abstract:Face Recognition is a widely used authentication method deployed for accessing personal digital devices like mobiles and laptops, digital door locks, or various security applications. However, presentation attacks in form of print, video and mask can circumvent such authentication methods. Several solutions based on texture features are proposed in the state-of-the-art; nevertheless, they are sensitive to varying illumination conditions and are less resilient against 2D and 3D attacks. In this paper, we propose a novel 3-stream compact Xception framework (3sXcsNet) consisting of four input streams RGB, MSRCR, MSRCP, and a depth map to form two specific 3-stream fusion (CRF and CPF) to mitigate the illumination scenarios. These streams provide discriminative features. RGB images have rich texture features; MSRCR and MSRCP images are illumination invariant and preserve better chromaticity applied on a color or intensity channel, respectively. In addition, an auxiliary depth map that provides depth information for each pixel makes it easier to analyze features and recognize whether the input image is from a real person or a spoof medium. The 3-stream CRF and CPF represent the features differently and feed independently to a deep CNN compact Xception with a CBAM network. These feature maps are fused using an average fusion mechanism for classification of real and spoof faces. We utilize both 2D and 3D attack datasets namely, REPLAY-ATTACK, CASIA-FASD, OULU-NPU, and 3DMAD to evaluate the effectiveness of the proposed framework. We attain an EER of 1.27% and 0.19% for CRF fusion, as well as 1.48% and 0.20% for CPF fusion when assessing performance on the CASIA-FASD and REPLAY-ATTACK datasets, respectively. On the OULU-NPU dataset, we obtain the most favorable results for two protocols while employing CRF fusion, resulting in ACER metrics of 0.7% and 3.2±2.7%, respectively. On the other hand, CPF fusion outperformed with an ACER of 1.8±1.0% for one protocol. Our findings on intra-database outperform the current state-of-the-art. We also perform cross-database testing to assess the generalization capability of the framework on 2D and 3D attack datasets. Furthermore, the proposed method outperforms both fusion procedures in terms of error rate HTER for intra-database and cross-database testing on the 3DMAD dataset.

Enhancing 2D-3D facial recognition accuracy of truncated-hiden faces using fused multi-model biometric deep features

Learning Individual-Specific Dictionaries With Fused Multiple Features For Face Recognition

Multi-channel Deep 3D Face Recognition

Towards Reading Beyond Faces for Sparsity-aware 3D/4D Affect Recognition

Enhancing Facial Classification and Recognition using 3D Facial Models and Deep Learning

Depth Map Denoising Network and Lightweight Fusion Network for Enhanced 3D Face Recognition

3sXcsNet: A framework for face presentation attack detection using deep learning

Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks

HyperFace: A Deep Fusion Model for Hyperspectral Face Recognition

Enhancing facial recognition accuracy through multi-scale feature fusion and spatial attention mechanisms

Multi-modal Face Anti-spoofing Using Multi-fusion Network and Global Depth-wise Convolution

Reconstructing A Large Scale 3D Face Dataset for Deep 3D Face Identification

Deblurring Method of Face Recognition AI Technology Based on Deep Learning

Deep Learning-Based 3D Face Recognition Using Derived Features from Point Cloud

High-Accuracy RGB-D Face Recognition via Segmentation-Aware Face Depth Estimation and Mask-Guided Attention Network

Facial Recognition Using Convolutional Neural Network Using Real-Time Data

Enhanced Hybrid Vision Transformer with Multi-Scale Feature Integration and Patch Dropping for Facial Expression Recognition

Fusing magnitude and phase features with multiple face models for robust face recognition

Face Detection With End-To-End Integration Of A Convnet And A 3d Model

Differential 3D Facial Recognition: Adding 3D to Your State-of-the-Art 2D Method