Abstract:As an essential component of experts and intelligent systems, Masked Face Recognition (MFR) has been applied to various applications, but it is still a challenging task due to the aggravated uncertainty caused by mask occlusion. Most existing MFR methods are deterministic point embedding models that are limited in representing the uncertainty in masked face images. Data Uncertainty Learning (DUL) is an advanced uncertainty modeling method, but there are two problems when it is applied to MFR task: (1) the masked face tends to be regarded as noise due to the mask occlusion, which weakens its optimization; (2) the large representation difference between face and masked face results in a dispersed intra-class distribution. To solve the above problems, we propose a novel masked face data uncertainty learning method (MaskDUF) for MFR task, which can adaptively adjust the optimization weight by modeling the uncertainty and measuring the recognizability of samples, thus learning an ideal sample distribution with compact intra-class, discrepant inter-class and distant noise. Specifically, a Hard Kullback–Leibler Divergence (H-KLD) method is proposed to serve as an adaptive variance regularizer for masked faces, which contributes to learning more accurate uncertainty representations and avoiding overfitting noise. Moreover, by combining feature magnitude and variance uncertainty, Mask Uncertainty Fluctuation (MUF) is proposed to comprehensively measure sample recognizability, which contributes to enhancing the learning preference of masked faces and constructing a more compact cone-like intra-class distribution. Finally, compared with other advanced models, MaskDUF achieves an average accuracy improvement of 1.33% to 13.28%, and its effectiveness and strong robustness are also proved by ablation study, noise experiment and parametric analysis.

Gaussian Mixture Distribution Makes Data Uncertainty Learning Better

Facial feature points detecting based on Gaussian Mixture Models

Dual Gaussian Modeling for Deep Face Embeddings

Gaussian Mixture Model Mapping in Face Recognition

Probabilistic Two-Dimensional Principal Component Analysis and Its Mixture Model for Face Recognition

DS-UI: Dual-Supervised Mixture of Gaussian Mixture Models for Uncertainty Inference in Image Recognition.

DS-UI: Dual-Supervised Mixture of Gaussian Mixture Models for Uncertainty Inference

Maskdul: Data Uncertainty Learning in Masked Face Recognition

Classification of Facial Images Using Gaussian Mixture Models.

Fine-Grained Image Classification with Gaussian Mixture Layer

MaskDUF: Data uncertainty learning in masked face recognition with mask uncertainty fluctuation

Generalizing Face Forgery Detection Via Uncertainty Learning

Gaussian Latent Representations for Uncertainty Estimation using Mahalanobis Distance in Deep Classifiers

HGMVAE: hierarchical disentanglement in Gaussian mixture variational autoencoder

Deep Gaussian mixture model for unsupervised image segmentation

von Mises-Fisher Mixture Model-based Deep learning: Application to Face Verification

Shaping Deep Feature Space Towards Gaussian Mixture for Visual Classification

Dual-Supervised Uncertainty Inference of MoGMM-FC Layer for Image Recognition

Joint Distribution across Representation Space for Out-of-Distribution Detection

Sequential Three-Way Decision Based on Gaussian Mixture Model and EM Algorithm

Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition.