Abstract:The world today is being hit by COVID-19. As opposed to fingerprints and ID cards, facial recognition technology can effectively prevent the spread of viruses in public places because it does not require contact with specific sensors. However, people also need to wear masks when entering public places, and masks will greatly affect the accuracy of facial recognition. Accurately performing facial recognition while people wear masks is a great challenge. In order to solve the problem of low facial recognition accuracy with mask wearers during the COVID-19 epidemic, we propose a masked-face recognition algorithm based on large margin cosine loss (MFCosface). Due to insufficient masked-face data for training, we designed a masked-face image generation algorithm based on the detection of the detection of key facial features. The face is detected and aligned through a multi-task cascaded convolutional network; and then we detect the key features of the face and select the mask template for coverage according to the positional information of the key features. Finally, we generate the corresponding masked-face image. Through analysis of the masked-face images, we found that triplet loss is not applicable to our datasets, because the results of online triplet selection contain fewer mask changes, making it difficult for the model to learn the relationship between mask occlusion and feature mapping. We use a large margin cosine loss as the loss function for training, which can map all the feature samples in a feature space with a smaller intra-class distance and a larger inter-class distance. In order to make the model pay more attention to the area that is not covered by the mask, we designed an Att-inception module that combines the Inception-Resnet module and the convolutional block attention module, which increases the weight of any unoccluded area in the feature map, thereby enlarging the unoccluded area's contribution to the identification process. Experiments on several masked-face datasets have proved that our algorithm greatly improves the accuracy of masked-face recognition, and can accurately perform facial recognition with masked subjects.

Triplet Decoupling Network for Masked Face Verification

Towards Mask-robust Face Recognition.

MTCNN and FACENET Based Access Control System for Face Detection and Recognition

Mask or Non-Mask? Robust Face Mask Detector via Triplet-Consistency Representation Learning

Masked Face Recognition Using MobileNetV2.

A Lightweight Face Verification Based on Adaptive Cascade Network and Triplet Loss Function

Masked Face Detection Using A Two-stage Classification Approach in the COVID-19 Era

A Joint Feature Aggregation Method for Robust Masked Face Recognition

Seeing through the Mask: Multi-task Generative Mask Decoupling Face Recognition

MFCosface: A Masked-Face Recognition Algorithm Based on Large Margin Cosine Loss

Consistent Sub-decision Network for Low-quality Masked Face Recognition

Masked Face Recognition System Based on Attention Mechanism

Masked Face Recognition With Mask Transfer and Self-Attention Under the COVID-19 Pandemic

Deep Representation for Partially Occluded Face Verification

Face Recognition Method of Mask Occlusion

Joint Holistic and Masked Face Recognition

Triplet Distillation for Deep Face Recognition

Occlusion Robust Face Recognition Based on Mask Learning with Pairwise Differential Siamese Network

Efficient Transfer Learning Combined Skip-Connected Structure for Masked Face Poses Classification

MaskOut: A Data Augmentation Method for Masked Face Recognition.

Depth map guided triplet network for deepfake face detection