Abstract:One of the main challenges for feature representation in deep learning-based classification is the design of appropriate loss functions that exhibit strong discriminative power. The classical softmax loss does not explicitly encourage discriminative learning of features. A popular direction of research is to incorporate margins in well-established losses in order to enforce extra intra-class compactness and inter-class separability, which, however, were developed through heuristic means, as opposed to rigorous mathematical principles. In this work, we attempt to address this limitation by formulating the principled optimization objective as learning towards the largest margins. Specifically, we firstly propose to employ the class margin as the measure of inter-class separability, and the sample margin as the measure of intra-class compactness. Accordingly, to encourage discriminative representation of features, the loss function should promote the largest possible margins for both classes and samples. Furthermore, we derive a generalized margin softmax loss to draw general conclusions for the existing margin-based losses. Not only does this principled framework offer new perspectives to understand and interpret existing margin-based losses, but it also provides new insights that can guide the design of new tools, including \textit{sample margin regularization} and \textit{largest margin softmax loss} for class balanced cases, and \textit{zero centroid regularization} for class imbalanced cases. Experimental results demonstrate the effectiveness of our strategy for multiple tasks including visual classification, imbalanced classification, person re-identification, and face verification.

Largest Center-Specific Margin for Dimension Reduction

Self-centralized Jointly Sparse Maximum Margin Criterion for Robust Dimensionality Reduction.

Large-margin Weakly Supervised Dimensionality Reduction.

Large Margin Low Rank Tensor Analysis

Local Feature Discriminant Projection

New Supervised Locally Linear Embedding for Dimensionality Reduction Using Distance Metric Learning

Complete large margin linear discriminant analysis using mathematical programming approach

Large margin nearest local mean classifier

Unsupervised large margin discriminative projection.

Recursive Dimension Reduction Algorithm Based on Margin Discriminant Analysis

Learning Towards The Largest Margins.

Largest Margin Neighbor Linear Discriminant Analysis

Feature Reduction Using Locally Linear Embedding and Distance Metric Learning

Max-K-Min Distance Analysis for Dimension Reduction

Scaling cut criterion-based discriminant analysis for supervised dimension reduction

Linear discriminant regression and local discriminant analysis based dimensionality reduction algorithm

Efficiently Learning a Distance Metric for Large Margin Nearest Neighbor Classification.

Laplacian MinMax Discriminant Projection and Its Applications.

Non-I.I.D. Multi-Instance Dimensionality Reduction by Learning a Maximum Bag Margin Subspace

Reconstructable generalized maximum scatter difference discriminant analysis

Joint Principal Component and Discriminant Analysis for Dimensionality Reduction