Abstract:The objective of deep metric learning (DML) is to learn embeddings that can capture semantic similarity and dissimilarity information among data points. Existing pairwise or tripletwise loss functions used in DML are known to suffer from slow convergence due to a large proportion of trivial pairs or triplets as the model improves. To improve this, ranking-motivated structured losses are proposed recently to incorporate multiple examples and exploit the structured information among them. They converge faster and achieve state-of-the-art performance. In this work, we unveil two limitations of existing ranking-motivated structured losses and propose a novel ranked list loss to solve both of them. First, given a query, only a fraction of data points is incorporated to build the similarity structure. Consequently, some useful examples are ignored and the structure is less informative. To address this, we propose to build a set-based similarity structure by exploiting all instances in the gallery. The learning setting can be interpreted as few-shot retrieval: given a mini-batch, every example is iteratively used as a query, and the rest ones compose the gallery to search, i.e., the support set in few-shot setting. The rest examples are split into a positive set and a negative set. For every mini-batch, the learning objective of ranked list loss is to make the query closer to the positive set than to the negative set by a margin. Second, previous methods aim to pull positive pairs as close as possible in the embedding space. As a result, the intraclass data distribution tends to be extremely compressed. In contrast, we propose to learn a hypersphere for each class in order to preserve useful similarity structure inside it, which functions as regularisation. Extensive experiments demonstrate the superiority of our proposal by comparing with the state-of-the-art methods on the fine-grained image retrieval task. Our source code is available online: https://github.com/XinshaoAmosWang/Ranked-List-Loss-for-DML.

Improved Embeddings with Easy Positive Triplet Mining

Learning User Interest with Improved Triplet Deep Ranking and Web-Image Priors for Topic-Related Video Summarization.

The Dilemma of TriHard Loss and an Element-Weighted TriHard Loss for Person Re-Identification

Visual Embedding Augmentation in Fourier Domain for Deep Metric Learning

VSE++: Improving Visual-Semantic Embeddings with Hard Negatives

Ranked List Loss for Deep Metric Learning

Feature Fusion for Image Retrieval with Adaptive Bitrate Allocation and Hard Negative Mining.

Better and Faster: Exponential Loss for Image Patch Matching

Assignment Problem Based Deep Embedding

Enhancing Contrastive Learning with Positive Pair Mining for Few-shot Hyperspectral Image Classification

Enhancing Remote Sensing Image Retrieval with Triplet Deep Metric Learning Network

Embedding Deep Metric for Person Re-identication A Study Against Large Variations

Enhancing image retrieval through entropy-based deep metric learning

Semantic-Aware Triplet Loss for Image Classification.

Semantic Positive Pairs for Enhancing Visual Representation Learning of Instance Discrimination methods

An Adversarial Approach To Hard Triplet Generation

Mhef-Tripnet: Mixed Triplet Loss With Hard Example Feedback Network For Image Retrieval

Deep Visual Semantic Embedding with Text Data Augmentation and Word Embedding Initialization

Deep embedding learning with adaptive large margin N-pair loss for image retrieval and clustering

Learning Deep Optimal Embeddings with Sinkhorn Divergences

NV-Retriever: Improving text embedding models with effective hard-negative mining