Abstract:<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> The corresponding author is Prof. Yang Cong. This work is supported by Nature Science Foundation of China under Grant (61722311, U1613214, 61533015) and CAS-Youth Innovation Promotion Association Scholarship (2012163)Recently, many machine learning problems rely on a valuable tool: metric learning. However, in many applications, large-scale applications embedded in high-dimensional feature space may induce both computation and storage requirements to grow quadratically. In order to tackle these challenges, in this paper, we intend to establish a robust metric learning formulation with the expectation that online metric learning and parallel optimization can solve large-scale and high-dimensional data efficiently, respectively. Specifically, based on the matrix factorization strategy, the first step aims to learn a similarity function in the objective formulation for similarity measurement; in the second step, we derive a variational trace norm to promote low-rankness on the transformation matrix. After converting this variational regularization into its separable form, for the model optimization, we present an parallel block coordinate descent method to learn the optimal metric parameters, which can handle the high-dimensional data in an efficient way. Crucially, our method shares the efficiency and flexibility of block coordinate descent method, and it is also guaranteed to converge to the optimal solution. Finally, we evaluate our approach by analyzing scene categorization dataset with tens of thousands of dimensions, and the experimental results show the effectiveness of our proposed model.

Robust Distance Metric Learning Via Simultaneous L1-Norm Minimization and Maximization.

Learning Robust Distance Metric with Side Information Via Ratio Minimization of Orthogonally Constrained L21-Norm Distances.

Learning Robust Distance Metric with Side Information via Ratio Minimization of Orthogonally Constrained l(2,1)-Norm Distances

Metric Learning Via Penalized Optimization.

Robust Metric Learning Based on Subspace Learning with Lp−norm

Robust distance metric learning with auxiliary knowledge

Constrained Metric Learning Via Distance Gap Maximization

Distance metric learning by minimal distance maximization

Distance Metric Learning Via Iterated Support Vector Machines

Towards Robust Discriminative Projections Learning via Non-Greedy <i>l</i><sub>2,1</sub>-Norm MinMax

An Efficient Sparse Metric Learning in High-Dimensional Space Via L1-Penalized Log-Determinant Regularization

Regularized Large Margin Distance Metric Learning.

Efficient Dual Approach to Distance Metric Learning

New Robust Metric Learning Model Using Maximum Correntropy Criterion

Learning a Distance Metric by Empirical Loss Minimization

Constrained Empirical Risk Minimization Framework for Distance Metric Learning.

Online Low-Rank Metric Learning via Parallel Coordinate Descent Method

Robust and Discriminative Distance for Multi-Instance Learning

Iterated Support Vector Machines for Distance Metric Learning

Toward Certified Robustness of Distance Metric Learning

Low-Rank Similarity Metric Learning In High Dimensions