Abstract:<sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> The corresponding author is Prof. Yang Cong. This work is supported by Nature Science Foundation of China under Grant (61722311, U1613214, 61533015) and CAS-Youth Innovation Promotion Association Scholarship (2012163)Recently, many machine learning problems rely on a valuable tool: metric learning. However, in many applications, large-scale applications embedded in high-dimensional feature space may induce both computation and storage requirements to grow quadratically. In order to tackle these challenges, in this paper, we intend to establish a robust metric learning formulation with the expectation that online metric learning and parallel optimization can solve large-scale and high-dimensional data efficiently, respectively. Specifically, based on the matrix factorization strategy, the first step aims to learn a similarity function in the objective formulation for similarity measurement; in the second step, we derive a variational trace norm to promote low-rankness on the transformation matrix. After converting this variational regularization into its separable form, for the model optimization, we present an parallel block coordinate descent method to learn the optimal metric parameters, which can handle the high-dimensional data in an efficient way. Crucially, our method shares the efficiency and flexibility of block coordinate descent method, and it is also guaranteed to converge to the optimal solution. Finally, we evaluate our approach by analyzing scene categorization dataset with tens of thousands of dimensions, and the experimental results show the effectiveness of our proposed model.

Fixed-Rank Supervised Metric Learning On Riemannian Manifold

Low Rank Metric Learning with Manifold Regularization

Low-Rank Similarity Metric Learning In High Dimensions

Towards Generalized and Efficient Metric Learning on Riemannian Manifold.

Fast Low-rank Metric Learning for Large-scale and High-dimensional Data

Non-linear Metric Learning Using Metric Tensor.

A Novel Riemannian Metric Based on Riemannian Structure and Scaling Information for Fixed Low-Rank Matrix Completion

A Riemannian rank-adaptive method for low-rank matrix completion

Learning Riemannian Metrics

Adaptive Metric Learning with the Low Rank Constraint

Manifold Preserving: an Intrinsic Approach for Semisupervised Distance Metric Learning

Efficient Stochastic Optimization for Low-Rank Distance Metric Learning.

Online Low-Rank Metric Learning via Parallel Coordinate Descent Method

Riemannian Conjugate Gradient Method for Low-Rank Tensor Completion

Riemannian manifold learning.

High-Rankness Regularized Semi-Supervised Deep Metric Learning for Remote Sensing Imagery

Algorithm for Riemannian Manifold Learning

Metric Learning Via Penalized Optimization.

Robust Metric Learning on Grassmann Manifolds with Generalization Guarantees.

Riemannian Submanifold Tracking on Low-Rank Algebraic Variety.

Parameter Estimation for Generalized Low-Rank Matrix Sensing by Learning on Riemannian Manifolds