Abstract:Many application problems such as data visualization, document retrieval, image annotation, col- laborative filtering, and machine translation can be formalized as a task that utilizes a similarity function between objects in two heterogeneous spaces. In this paper, we address the problem of automatically learning such a similarity function using labeled training data. Conventional metric learning can be viewed as learning of similarity function over one single space, while the 'metric learning' problem in this paper can be regarded as learning of similarity function over two different spaces. We assume that the objects in the two original spaces are linearly mapped into a new space and dot product in the new space is defined as the similarity function. The metric learning problem then becomes that of learning the two linear mapping functions from training data. We then give a general and theoretically sound solution to the learning problem. Specifically, we prove that although the learning problem is non-convex, the global optimal solu- tion exists and one can find the optimal solution using Singular Value Decomposition (SVD). We also show that the solution is 'generalizable' to unobserved data and it is possible to kernelize the method. We conducted two experiments; one experiment shows that keywords and images can be visualized in the same space based on the similarity function learned with our method, and the other experiment shows that the accuracy of document retrieval can be improved with the similarity function (relevance function) learned with our method.

Learning Similarity Function between Objects in Heterogeneous Spaces

Online Similarity Learning for Visual Tracking

A New Similarity Space Tailored for Supervised Deep Metric Learning

What Makes Objects Similar: A Unified Multi-Metric Learning Approach.

Learning Similarity Measures in Non-Orthogonal Space.

Semi-supervised LDA Based Method for Similarity Distance Metric Learning.

Learning Similarity Metric with SVM.

Learning Non-Metric Partial Similarity Based on Maximal Margin Criterion

Low-Rank Similarity Metric Learning In High Dimensions

Similarity Measure Learning in Closed-Form Solution for Image Classification.

A Similarity Metric in Image Searching.

Kernel-driven similarity learning.

Unsupervised Hyperbolic Metric Learning

Metricfusion: Generalized Metric Swarm Learning For Similarity Measure

Face Verification Based on Weighted Subspace and Similarity Metric Learning

Deep Metric Learning using Similarities from Nonlinear Rank Approximations

Sparse online relative similarity learning

Spectral Approximation to Point Set Similarity Metric

Soml: Sparse Online Metric Learning with Application to Image Retrieval

Supervised Learning with Similarity Functions

An Optimal Transport Approach to Deep Metric Learning (student Abstract)