Abstract:One of the main challenges for feature representation in deep learning-based classification is the design of appropriate loss functions that exhibit strong discriminative power. The classical softmax loss does not explicitly encourage discriminative learning of features. A popular direction of research is to incorporate margins in well-established losses in order to enforce extra intra-class compactness and inter-class separability, which, however, were developed through heuristic means, as opposed to rigorous mathematical principles. In this work, we attempt to address this limitation by formulating the principled optimization objective as learning towards the largest margins. Specifically, we firstly propose to employ the class margin as the measure of inter-class separability, and the sample margin as the measure of intra-class compactness. Accordingly, to encourage discriminative representation of features, the loss function should promote the largest possible margins for both classes and samples. Furthermore, we derive a generalized margin softmax loss to draw general conclusions for the existing margin-based losses. Not only does this principled framework offer new perspectives to understand and interpret existing margin-based losses, but it also provides new insights that can guide the design of new tools, including \textit{sample margin regularization} and \textit{largest margin softmax loss} for class balanced cases, and \textit{zero centroid regularization} for class imbalanced cases. Experimental results demonstrate the effectiveness of our strategy for multiple tasks including visual classification, imbalanced classification, person re-identification, and face verification.

On Ψ-Learning

On Psi-Learning

A Multi-Class Large Margin Classifier

A Local Online Learning Approach for Non-linear Data.

Learning Towards The Largest Margins.

Recent Advances in Large Margin Learning

Large Margin Deep Neural Networks: Theory and Algorithms.

Scalable Large-Margin Mahalanobis Distance Metric Learning

On the Optimization of Margin Distribution

Large-Margin Label-Calibrated Support Vector Machines for Positive and Unlabeled Learning

On the Insufficiency of the Large Margins Theory in Explaining the Performance of Ensemble Methods

Learning to Generalize Provably in Learning to Optimize

Improving generalization of deep neural networks by leveraging margin distribution

Nonlinear Online Classification Algorithm with Probability Margin

Large Margin Discriminative Loss for Classification

Large Margin Learning of Upstream Scene Understanding Models

Convex large margin training techniques: unsupervised, semi-supervised, and robust support vector machines

On the doubt about margin explanation of boosting

Large Margin Partial Label Machine

Laplacian Margin Distribution Boosting for Learning from Sparsely Labeled Data

Cost-Sensitive Large Margin Distribution Machine