Abstract:<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> The corresponding author is Prof. Yang Cong. This work is supported by Nature Science Foundation of China under Grant (61722311, U1613214, 61533015) and CAS-Youth Innovation Promotion Association Scholarship (2012163)Recently, many machine learning problems rely on a valuable tool: metric learning. However, in many applications, large-scale applications embedded in high-dimensional feature space may induce both computation and storage requirements to grow quadratically. In order to tackle these challenges, in this paper, we intend to establish a robust metric learning formulation with the expectation that online metric learning and parallel optimization can solve large-scale and high-dimensional data efficiently, respectively. Specifically, based on the matrix factorization strategy, the first step aims to learn a similarity function in the objective formulation for similarity measurement; in the second step, we derive a variational trace norm to promote low-rankness on the transformation matrix. After converting this variational regularization into its separable form, for the model optimization, we present an parallel block coordinate descent method to learn the optimal metric parameters, which can handle the high-dimensional data in an efficient way. Crucially, our method shares the efficiency and flexibility of block coordinate descent method, and it is also guaranteed to converge to the optimal solution. Finally, we evaluate our approach by analyzing scene categorization dataset with tens of thousands of dimensions, and the experimental results show the effectiveness of our proposed model.

An Efficient Sparse Metric Learning in High-Dimensional Space Via L1-Penalized Log-Determinant Regularization

Metric Learning Via Penalized Optimization.

Towards Making High Dimensional Distance Metric Learning Practical

Distance Metric Learning with Penalized Linear Discriminant Analysis

Semi-supervised Sparse Metric Learning Using Alternating Linearization Optimization

Efficient Dual Approach to Distance Metric Learning

Robust Metric Learning Based on Subspace Learning with Lp−norm

Low-Rank Similarity Metric Learning In High Dimensions

Efficient Stochastic Optimization for Low-Rank Distance Metric Learning.

Scalable Large-Margin Mahalanobis Distance Metric Learning

Local Feature Discriminant Projection

Robust Distance Metric Learning Via Simultaneous L1-Norm Minimization and Maximization.

Online Low-Rank Metric Learning via Parallel Coordinate Descent Method

A Fast Diagonal Distance Metric Learning Approach for Large-Scale Datasets

Robust dimensionality reduction via feature space to feature space distance metric learning.

A scalable algorithm for learning a mahalanobis distance metric

Linear Subspace Learning via sparse dimension reduction

A Scalable Dual Approach to Semidefinite Metric Learning

Constrained Metric Learning Via Distance Gap Maximization

Large Scale Metric Learning

Distance metric learning by minimal distance maximization