Abstract:The central problem for most existing metric learning methods is to find a suitable projection matrix on the differences of all pairs of data points. However, a single unified projection matrix can hardly characterize all data similarities accurately as the practical data are usually very complicated, and simply adopting one global projection matrix might ignore important local patterns hidden in the dataset. To address this issue, this paper proposes a novel method dubbed "Data-Adaptive Metric Learning" (DAML), which constructs a data-adaptive projection matrix for each data pair by selectively combining a set of learned candidate matrices. As a result, every data pair can obtain a specific projection matrix, enabling the proposed DAML to flexibly fit the training data and produce discriminative projection results. The model of DAML is formulated as an optimization problem which jointly learns candidate projection matrices and their sparse combination for every data pair. Nevertheless, the over-fitting problem may occur due to the large amount of parameters to be learned. To tackle this issue, we adopt the Total Variation (TV) regularizer to align the scales of data embedding produced by all candidate projection matrices, and thus the generated metrics of these learned candidates are generally comparable. Furthermore, we extend the basic linear DAML model to the kernerlized version (denoted "KDAML") to handle the non-linear cases, and the Iterative Shrinkage-Thresholding Algorithm (ISTA) is employed to solve the optimization model. Intensive experimental results on various applications including retrieval, classification, and verification clearly demonstrate the superiority of our algorithm to other state-of-the-art metric learning methodologies.

Deep Metric Learning For The Target Cost In Unit-Selection Speech Synthesizer

A data driven method for target and concatenation cost calculation with KL-Divergence in Mandarin hybrid speech synthesis

Progressive Neural Networks Based Features Prediction for the Target Cost in Unit-Selection Speech Synthesizer

DNN-based unit selection using frame-sized speech segments

DMDSpeech: Distilled Diffusion Model Surpassing The Teacher in Zero-shot Speech Synthesis via Direct Metric Optimization

Extracting Unit Embeddings Using Sequence-To-Sequence Acoustic Models for Unit Selection Speech Synthesis

HMM-based Unit Selection Speech Synthesis Using Log Likelihood Ratios Derived from Perceptual Data

Learning and Modeling Unit Embeddings for Improving HMM-based Unit Selection Speech Synthesis

Learning and Modeling Unit Embeddings Using Deep Neural Networks for Unit-Selection-Based Mandarin Speech Synthesis.

Data-Adaptive Metric Learning with Scale Alignment.

Deep Metric Learning Via Adaptive Learnable Assessment

Unit Selection Speech Synthesis Using Frame-Sized Speech Segments and Neural Network Based Acoustic Models

MetricNet: Towards Improved Modeling for Non-Intrusive Speech Quality Assessment

A novel unit selection method for concatenation speech system using similarity measure

Improve distance metric learning by learning positions of class centers

Target Detection With Spatial-Spectral Adaptive Sample Generation and Deep Metric Learning for Hyperspectral Imagery

Distance-Dependent Metric Learning.

Scalable Angular Discriminative Deep Metric Learning for Face Recognition

Deep Distillation Metric Learning.

Deep Adversarial Metric Learning

Deep Factorized Metric Learning