Abstract:One of the main challenges for feature representation in deep learning-based classification is the design of appropriate loss functions that exhibit strong discriminative power. The classical softmax loss does not explicitly encourage discriminative learning of features. A popular direction of research is to incorporate margins in well-established losses in order to enforce extra intra-class compactness and inter-class separability, which, however, were developed through heuristic means, as opposed to rigorous mathematical principles. In this work, we attempt to address this limitation by formulating the principled optimization objective as learning towards the largest margins. Specifically, we firstly propose to employ the class margin as the measure of inter-class separability, and the sample margin as the measure of intra-class compactness. Accordingly, to encourage discriminative representation of features, the loss function should promote the largest possible margins for both classes and samples. Furthermore, we derive a generalized margin softmax loss to draw general conclusions for the existing margin-based losses. Not only does this principled framework offer new perspectives to understand and interpret existing margin-based losses, but it also provides new insights that can guide the design of new tools, including \textit{sample margin regularization} and \textit{largest margin softmax loss} for class balanced cases, and \textit{zero centroid regularization} for class imbalanced cases. Experimental results demonstrate the effectiveness of our strategy for multiple tasks including visual classification, imbalanced classification, person re-identification, and face verification.

Learning deep discriminative embeddings via joint rescaled features and log-probability centers

A Loss Combination Based Deep Model for Person Re-Identification

InterFace:Adjustable Angular Margin Inter-class Loss for Deep Face Recognition

On the Learning Property of Logistic and Softmax Losses for Deep Neural Networks

Learning Towards The Largest Margins.

Imbalance Robust Softmax for Deep Embeeding Learning

SO-softmax loss for discriminable embedding learning in CNNs

Class-Variant Margin Normalized Softmax Loss for Deep Face Recognition

Joint Supervision for Discriminative Feature Learning in Convolutional Neural Networks.

SubFace: learning with softmax approximation for face recognition

Learning Robust Facial Representation from the View of Diversity and Closeness

Exponential Discriminative Metric Embedding in Deep Learning

Margin Loss: Making Faces More Separable

Softmax Dissection: Towards Understanding Intra- and Inter-class Objective for Embedding Learning

Towards Learning Spatially Discriminative Feature Representations

Deep center-based dual-constrained hashing for discriminative face image retrieval

Integrating Convolution and Sparse Coding for Learning Low-Dimensional Discriminative Image Representations

Frontal-Centers Guided Face: Boosting Face Recognition by Learning Pose-Invariant Features

X2-Softmax: Margin adaptive loss function for face recognition

Large-Margin Regularized Softmax Cross-Entropy Loss

Emphasizing Closeness and Diversity Simultaneously for Deep Face Representation.