Abstract:Face Recognition is a widely used authentication method deployed for accessing personal digital devices like mobiles and laptops, digital door locks, or various security applications. However, presentation attacks in form of print, video and mask can circumvent such authentication methods. Several solutions based on texture features are proposed in the state-of-the-art; nevertheless, they are sensitive to varying illumination conditions and are less resilient against 2D and 3D attacks. In this paper, we propose a novel 3-stream compact Xception framework (3sXcsNet) consisting of four input streams RGB, MSRCR, MSRCP, and a depth map to form two specific 3-stream fusion (CRF and CPF) to mitigate the illumination scenarios. These streams provide discriminative features. RGB images have rich texture features; MSRCR and MSRCP images are illumination invariant and preserve better chromaticity applied on a color or intensity channel, respectively. In addition, an auxiliary depth map that provides depth information for each pixel makes it easier to analyze features and recognize whether the input image is from a real person or a spoof medium. The 3-stream CRF and CPF represent the features differently and feed independently to a deep CNN compact Xception with a CBAM network. These feature maps are fused using an average fusion mechanism for classification of real and spoof faces. We utilize both 2D and 3D attack datasets namely, REPLAY-ATTACK, CASIA-FASD, OULU-NPU, and 3DMAD to evaluate the effectiveness of the proposed framework. We attain an EER of 1.27% and 0.19% for CRF fusion, as well as 1.48% and 0.20% for CPF fusion when assessing performance on the CASIA-FASD and REPLAY-ATTACK datasets, respectively. On the OULU-NPU dataset, we obtain the most favorable results for two protocols while employing CRF fusion, resulting in ACER metrics of 0.7% and 3.2±2.7%, respectively. On the other hand, CPF fusion outperformed with an ACER of 1.8±1.0% for one protocol. Our findings on intra-database outperform the current state-of-the-art. We also perform cross-database testing to assess the generalization capability of the framework on 2D and 3D attack datasets. Furthermore, the proposed method outperforms both fusion procedures in terms of error rate HTER for intra-database and cross-database testing on the 3DMAD dataset.

RGB+D and deep learning-based real-time detection of suspicious event in Bank-ATMs

Deep learning based anomaly detection in real-time video

Abnormal Behavior Detection of ATM Surveillance Videos Based on Pseudo-3D Residual Network

Abnormal Activity Recognition in Private Places Using Deep Learning: A Survey

A real time crime scene intelligent video surveillance systems in violence detection framework using deep learning techniques

SUSPICIOUS ACTIVITY DETECTION USING CCTV SURVEILLANCE VIDEO

ATM Fraud Detection using Streaming Data Analytics

Deep Learning for Automated Occlusion Edge Detection in RGB-D Frames

Artificial Intelligence of Things-assisted two-stream neural network for anomaly detection in surveillance Big Video Data

ANALYSIS OF WEAPON AND FIRE DETECTION ON DIFFERENT DATASETS IN ATMs

Edge-Computing-Enabled Abnormal Activity Recognition for Visual Surveillance

Deep Learning Approach for Suspicious Activity Detection from Surveillance Video

Real-Time Detection of ATM Abnormal Events Based on Optical Flow

A novel efficient method for abnormal face detection in ATM

Asymmetric Adaptive Fusion in a Two-Stream Network for RGB-D Human Detection

Security Event Recognition for Visual Surveillance

Auto Deep Learning-based Automated Surveillance Technique to Recognize the Activities in the Cyber-Physical System

Multi-Stream 3D Latent Feature Clustering for Abnormality Detection in Videos

Conv3D-Based Video Violence Detection Network Using Optical Flow and RGB Data

3sXcsNet: A framework for face presentation attack detection using deep learning

Autonomous Anomaly Detection System for Crime Monitoring and Alert Generation