Abstract:Face Recognition is a widely used authentication method deployed for accessing personal digital devices like mobiles and laptops, digital door locks, or various security applications. However, presentation attacks in form of print, video and mask can circumvent such authentication methods. Several solutions based on texture features are proposed in the state-of-the-art; nevertheless, they are sensitive to varying illumination conditions and are less resilient against 2D and 3D attacks. In this paper, we propose a novel 3-stream compact Xception framework (3sXcsNet) consisting of four input streams RGB, MSRCR, MSRCP, and a depth map to form two specific 3-stream fusion (CRF and CPF) to mitigate the illumination scenarios. These streams provide discriminative features. RGB images have rich texture features; MSRCR and MSRCP images are illumination invariant and preserve better chromaticity applied on a color or intensity channel, respectively. In addition, an auxiliary depth map that provides depth information for each pixel makes it easier to analyze features and recognize whether the input image is from a real person or a spoof medium. The 3-stream CRF and CPF represent the features differently and feed independently to a deep CNN compact Xception with a CBAM network. These feature maps are fused using an average fusion mechanism for classification of real and spoof faces. We utilize both 2D and 3D attack datasets namely, REPLAY-ATTACK, CASIA-FASD, OULU-NPU, and 3DMAD to evaluate the effectiveness of the proposed framework. We attain an EER of 1.27% and 0.19% for CRF fusion, as well as 1.48% and 0.20% for CPF fusion when assessing performance on the CASIA-FASD and REPLAY-ATTACK datasets, respectively. On the OULU-NPU dataset, we obtain the most favorable results for two protocols while employing CRF fusion, resulting in ACER metrics of 0.7% and 3.2±2.7%, respectively. On the other hand, CPF fusion outperformed with an ACER of 1.8±1.0% for one protocol. Our findings on intra-database outperform the current state-of-the-art. We also perform cross-database testing to assess the generalization capability of the framework on 2D and 3D attack datasets. Furthermore, the proposed method outperforms both fusion procedures in terms of error rate HTER for intra-database and cross-database testing on the 3DMAD dataset.

Optimized intelligent strategy for user authorization by facial recognition

Impact of self adaptive-elephant herding optimization towards neural network for facial emotion recognition

Emotion Recognition for Challenged People Facial Appearance in Social using Neural Network

Face Spoofing, Age, Gender and Facial Expression Recognition Using Advance Neural Network Architecture-Based Biometric System

Modelling an efficient hybridized approach for facial emotion recognition using unconstraint videos and deep learning approaches

Modified feature extraction techniques to enhance face and expression recognition

Primate Face Identification in the Wild

A Review Analysis on Face Recognition System with User Interface System

Improved multiview biometric object detection for anti spoofing frauds

Optimized face recognition algorithm using radial basis function neural networks and its practical applications

An efficient facial emotion recognition system using novel deep learning neural network-regression activation classifier

Facial expression recognition with trade-offs between data augmentation and deep learning features

Effective Facial Expression Recognition System Using Machine Learning

Micro-Facial Expression Recognition in Video Based on Optimal Convolutional Neural Network (MFEOCNN) Algorithm

Facial Image expression recognition and prediction system

Automated facial expression recognition using exemplar hybrid deep feature generation technique

Facial Expression Recognition using Facial Landmark Detection and Feature Extraction via Neural Networks

A feature boosted deep learning method for automatic facial expression recognition

Efficient Face Recognition System for Operating in Unconstrained Environments

3sXcsNet: A framework for face presentation attack detection using deep learning

Modeling and implementation of an automatic Access control system for secure permises using facial recognition