Abstract:In the era of coronavirus disease (COVID-19), wearing a mask could effectively protect people from the risk of infection and largely reduce transmission in public places. To prevent the spread of the virus, instruments are needed in public places to monitor whether people are wearing masks, which has higher requirements for the accuracy and speed of detection algorithms. To meet the demand for high accuracy and real-time monitoring, we propose a single-stage approach based on YOLOv4 to identify the face and whether to regulate the wearing of masks. In this approach, we propose a new feature pyramidal network based on the attention mechanism to reduce the loss of object information that can be caused by sampling and pooling in convolutional neural networks. The network is able to deeply mine the feature map for spatial and communication factors, and the multi-scale feature fusion makes the feature map equipped with location and semantic information. Based on the complete intersection over union (CIoU), a penalty function based on the norm is proposed to improve positioning accuracy, which is more accurate at the detection of small objects; the new bounding box regression function is called Norm CIoU (NCIoU). This function is applicable to various object-detection bounding box regression tasks. A combination of the two functions to calculate the confidence loss is used to mitigate the problem of the algorithm bias towards determinating no objects in the image. Moreover, we provide a dataset for recognizing faces and masks (RFM) that includes 12,133 realistic images. The dataset contains three categories: face, standardized mask and non-standardized mask. Experiments conducted on the dataset demonstrate that the proposed approach achieves mAP@.5:.95 69.70% and AP75 73.80%, outperforming the compared methods.

Face recognition in the scene of wearing a mask

Towards Mask-robust Face Recognition.

A Method for Standardized Wear Detection of Masks Based on Key Point Detection.

Masked Face Recognition Using MobileNetV2.

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Face mask recognition based on MTCNN and MobileNet

A Mask-Wearing Face Recognition Method Based on Low-Level Features and Deep Residual Networks

Masked face recognition with convolutional neural networks and local binary patterns

Efficient Masked Face Recognition Method during the COVID-19 Pandemic

Face Mask Identification Using Spatial and Frequency Features in Depth Image from Time-of-Flight Camera

A Face Detection and Standardized Mask-Wearing Recognition Algorithm

A Joint Feature Aggregation Method for Robust Masked Face Recognition

Fine Segmentation on Faces With Masks Based on a Multistep Iterative Segmentation Algorithm

Mask Recognition Method Based on Graph Convolutional Network

Masked Face Recognition With Mask Transfer and Self-Attention Under the COVID-19 Pandemic

ULN: an Efficient Face Recognition Method for Person Wearing a Mask

Face Mask-Wearing Detection Model Based on Loss Function and Attention Mechanism

Face mask recognition system using CNN model

Robust Deep Learning Method to Detect Face Masks

Masked Face Recognition Using MobileNet V2 with Transfer Learning

Face Mask Detection Using Machine Learning