Abstract:Deep embedding learning is expected to learn a metric space in which features have smaller maximal intra-class distance than minimal inter-class distance. In recent years, one research focus is to solve the open-set problem by discriminative deep embedding learning in the field of face recognition (FR) and person re-identification (re-ID). Apart from open-set problem, we find that imbalanced training data is another main factor causing the performance degradation of FR and re-ID, and data imbalance widely exists in the real applications. However, very little research explores why and how data imbalance influences the performance of FR and re-ID with softmax or its variants. In this work, we deeply investigate data imbalance in the perspective of neural network optimisation and feature distribution about softmax. We find one main reason of performance degradation caused by data imbalance is that the weights (from the penultimate fully-connected layer) are far from their class centers in feature space. Based on this investigation, we propose a unified framework, Imbalance-Robust Softmax (IR-Softmax), which can simultaneously solve the open-set problem and reduce the influence of data imbalance. IR-Softmax can generalise to any softmax and its variants (which are discriminative for open-set problem) by directly setting the weights as their class centers, naturally solving the data imbalance problem. In this work, we explicitly re-formulate two discriminative softmax (A-Softmax and AM-Softmax) under the framework of IR-Softmax. We conduct extensive experiments on FR databases (LFW, MegaFace) and re-ID database (Market-1501, Duke), and IR-Softmax outperforms many state-of-the-art methods.

Emphasizing Closeness and Diversity Simultaneously for Deep Face Representation.

Learning Robust Facial Representation from the View of Diversity and Closeness

Towards Mask-robust Face Recognition.

InterFace:Adjustable Angular Margin Inter-class Loss for Deep Face Recognition

Robust 3D Face Recognition by Local Shape Difference Boosting

EOGFACE: DEEP FACE RECOGNITION VIA EXTENSIONAL LOGITS

SSRFace: a face recognition framework against shallow data

Sample Diversity, Representation Effectiveness and Robust Dictionary Learning for Face Recognition.

SubFace: learning with softmax approximation for face recognition

Multiple Representation Based Sample Diversity for Face Recognition

K-Face Net: A Two-Stage Framework for Balanced Feature Space in Facial Expression Recognition

Imbalance Robust Softmax for Deep Embeeding Learning

EnhanceFace: Adaptive Weighted SoftMax Loss for Deep Face Recognition

Robust Face Recognition via Multimodal Deep Face Representation

Learning Diversified Feature Representations for Facial Expression Recognition in the Wild

ArcFace: Additive Angular Margin Loss for Deep Face Recognition

Scarce Face Recognition Via Two-Layer Collaborative Representation.

Class-Variant Margin Normalized Softmax Loss for Deep Face Recognition

A discriminative multiscale feature extraction network for facial expression recognition in the wild

Exploiting Enhanced and Robust RGB-D Face Representation Via Progressive Multi-Modal Learning

Deep Face Recognition Based on Penalty Cosface.