Abstract:Metric learning aims to learn a distance metric to properly measure the similarities between pairwise examples. Most existing learning algorithms are designed to reduce intra-class distances and meanwhile enlarge inter-class distances by critically introducing a margin between intra-class and inter-class distances. However, such learning objectives may yield boundless (distance) metric space, because their enlargements on inter-class distances are usually unconstrained. In this case, excessively enlarged inter-class distances would relatively reduce the ratio of margin to the whole distance range (i.e., the margin-range-ratio), and thus being against the initial large-margin purpose for discriminating the similarities of data pairs. To address this issue, we propose a new boundary-restricted metric (BRM), which confines the metric space by a restriction function. Such a restriction function is monotonous and gradually converges to an upper bound, which suppresses excessively large distances of data pairs and concurrently maintains the reliable discriminability. After that, the learned metric can be successfully restricted in a finite region, and thereby avoiding the reduction of margin-range-ratio. Theoretically, we prove that BRM tightens the generalization error bound of the traditional learning model without sacrificing the fitting capability or destroying the topological property of the learned metric, which implies that BRM makes a good bias-variance tradeoff for the metric learning task. Extensive experiments on toy data and real-world datasets validate the superiority of our approach over the state-of-the-art metric learning methods.

Total Margin Based Balanced Relative Margin Machine

Margin Distribution Analysis

Scalable Optimal Margin Distribution Machine

A Rough Margin Based Support Vector Machine.

A Minimax Probability Machine for Nondecomposable Performance Measures

A Double Margin Based Fuzzy Support Vector Machine Algorithm

Multi-label Optimal Margin Distribution Machine

Unified Binary and Multiclass Margin-Based Classification

Boosting Through Optimization of Margin Distributions

Borderline-margin loss based deep metric learning framework for imbalanced data

Maximum Margin Clustering with Multivariate Loss Function.

A rough margin based fuzzy support vector machine

On the Optimization of Margin Distribution

A Refined Margin Analysis for Boosting Algorithms Via Equilibrium Margin

On the doubt about margin explanation of boosting

An Equalized Margin Loss for Face Recognition.

Rough margin based core vector machine

Margin Calibration for Long-Tailed Visual Recognition

Learning Imbalanced Datasets with Maximum Margin Loss

Boundary-restricted metric learning

Worst-Case Discriminative Feature Learning via Max-Min Ratio Analysis