Abstract:The central problem for most existing metric learning methods is to find a suitable projection matrix on the differences of all pairs of data points. However, a single unified projection matrix can hardly characterize all data similarities accurately as the practical data are usually very complicated, and simply adopting one global projection matrix might ignore important local patterns hidden in the dataset. To address this issue, this paper proposes a novel method dubbed "Data-Adaptive Metric Learning" (DAML), which constructs a data-adaptive projection matrix for each data pair by selectively combining a set of learned candidate matrices. As a result, every data pair can obtain a specific projection matrix, enabling the proposed DAML to flexibly fit the training data and produce discriminative projection results. The model of DAML is formulated as an optimization problem which jointly learns candidate projection matrices and their sparse combination for every data pair. Nevertheless, the over-fitting problem may occur due to the large amount of parameters to be learned. To tackle this issue, we adopt the Total Variation (TV) regularizer to align the scales of data embedding produced by all candidate projection matrices, and thus the generated metrics of these learned candidates are generally comparable. Furthermore, we extend the basic linear DAML model to the kernerlized version (denoted "KDAML") to handle the non-linear cases, and the Iterative Shrinkage-Thresholding Algorithm (ISTA) is employed to solve the optimization model. Intensive experimental results on various applications including retrieval, classification, and verification clearly demonstrate the superiority of our algorithm to other state-of-the-art metric learning methodologies.

Scalable unsupervised alignment of general metric and non-metric structures

Hierarchical Optimal Transport for Multimodal Distribution Alignment

A General Framework for 3D Model Co-Alignment.

Covariance alignment: from maximum likelihood estimation to Gromov-Wasserstein

Robust Attributed Graph Alignment Via Joint Structure Learning and Optimal Transport

Distributional Learning for Network Alignment with Global Constraints.

Data-Adaptive Metric Learning with Scale Alignment.

Gromov-Wasserstein optimal transport to align single-cell multi-omics data

Equivariant Deep Weight Space Alignment

Extending Generalized Unsupervised Manifold Alignment

Graph Metric Learning Via Gershgorin Disc Alignment

Unsupervised Manifold Alignment Using Soft-Assign Technique

Unsupervised Iterative Manifold Alignment Via Local Feature Histograms

SAlign: A Graph Neural Attention Framework for Aligning Structurally Heterogeneous Networks

Manifold alignment using discrete surface Ricci flow

Manifold Alignment Based on Sparse Local Structures of More Corresponding Pairs.

Aligning Embeddings and Geometric Random Graphs: Informational Results and Computational Approaches for the Procrustes-Wasserstein Problem

Neural Entropic Gromov-Wasserstein Alignment

Manifold Alignment Via Global and Local Structures Preserving PCA Framework.

Signed Graph Metric Learning via Gershgorin Disc Perfect Alignment

Semi-definite Manifold Alignment