Abstract:The objective of deep metric learning (DML) is to learn embeddings that can capture semantic similarity and dissimilarity information among data points. Existing pairwise or tripletwise loss functions used in DML are known to suffer from slow convergence due to a large proportion of trivial pairs or triplets as the model improves. To improve this, ranking-motivated structured losses are proposed recently to incorporate multiple examples and exploit the structured information among them. They converge faster and achieve state-of-the-art performance. In this work, we unveil two limitations of existing ranking-motivated structured losses and propose a novel ranked list loss to solve both of them. First, given a query, only a fraction of data points is incorporated to build the similarity structure. Consequently, some useful examples are ignored and the structure is less informative. To address this, we propose to build a set-based similarity structure by exploiting all instances in the gallery. The learning setting can be interpreted as few-shot retrieval: given a mini-batch, every example is iteratively used as a query, and the rest ones compose the gallery to search, i.e., the support set in few-shot setting. The rest examples are split into a positive set and a negative set. For every mini-batch, the learning objective of ranked list loss is to make the query closer to the positive set than to the negative set by a margin. Second, previous methods aim to pull positive pairs as close as possible in the embedding space. As a result, the intraclass data distribution tends to be extremely compressed. In contrast, we propose to learn a hypersphere for each class in order to preserve useful similarity structure inside it, which functions as regularisation. Extensive experiments demonstrate the superiority of our proposal by comparing with the state-of-the-art methods on the fine-grained image retrieval task. Our source code is available online: https://github.com/XinshaoAmosWang/Ranked-List-Loss-for-DML.

Interclass-Relativity-Adaptive Metric Learning for Cross-Modal Matching and Beyond

Universal Weighting Metric Learning for Cross-Modal Retrieval

Adversarial-Metric Learning for Audio-Visual Cross-Modal Matching

Less is Better: Exponential Loss for Cross-Modal Matching

Re-ranking image-text matching by adaptive metric fusion

On Metric Learning for Audio-Text Cross-Modal Retrieval

Ranked List Loss for Deep Metric Learning

Multilevel metric rank match for person re-identification

Cross-modal Deep Metric Learning with Multi-Task Regularization

Quaternion Representation Learning for cross-modal matching

Attribute-Image Person Re-identification Via Modal-Consistent Metric Learning

Metric networks for enhanced perception of non-local semantic information

LLM: Learning Cross-Modality Person Re-Identification Via Low-Rank Local Matching

Supervised Metric Learning to Rank for Retrieval via Contextual Similarity Optimization

Cross-view Asymmetric Metric Learning for Unsupervised Person Re-identification

Relative Entropic Optimal Transport: a (Prior-Aware) Matching Perspective to (unbalanced) Classification

Learning Memory-Augmented Unidirectional Metrics for Cross-modality Person Re-identification

A New Date-Balanced Method Based on Adaptive Asymmetric and Diversity Regularization in Person Re-Identification.

Learning Relation Alignment for Calibrated Cross-modal Retrieval

Two-Level Multi-Task Metric Learning with Application to Multi-Classification

Cross-Modal Metric Learning for AUC Optimization.