Abstract:The objective of deep metric learning (DML) is to learn embeddings that can capture semantic similarity and dissimilarity information among data points. Existing pairwise or tripletwise loss functions used in DML are known to suffer from slow convergence due to a large proportion of trivial pairs or triplets as the model improves. To improve this, ranking-motivated structured losses are proposed recently to incorporate multiple examples and exploit the structured information among them. They converge faster and achieve state-of-the-art performance. In this work, we unveil two limitations of existing ranking-motivated structured losses and propose a novel ranked list loss to solve both of them. First, given a query, only a fraction of data points is incorporated to build the similarity structure. Consequently, some useful examples are ignored and the structure is less informative. To address this, we propose to build a set-based similarity structure by exploiting all instances in the gallery. The learning setting can be interpreted as few-shot retrieval: given a mini-batch, every example is iteratively used as a query, and the rest ones compose the gallery to search, i.e., the support set in few-shot setting. The rest examples are split into a positive set and a negative set. For every mini-batch, the learning objective of ranked list loss is to make the query closer to the positive set than to the negative set by a margin. Second, previous methods aim to pull positive pairs as close as possible in the embedding space. As a result, the intraclass data distribution tends to be extremely compressed. In contrast, we propose to learn a hypersphere for each class in order to preserve useful similarity structure inside it, which functions as regularisation. Extensive experiments demonstrate the superiority of our proposal by comparing with the state-of-the-art methods on the fine-grained image retrieval task. Our source code is available online: https://github.com/XinshaoAmosWang/Ranked-List-Loss-for-DML.

Deep Learning on Small Datasets without Pre-Training using Cosine Loss

Ranked List Loss for Deep Metric Learning

The Hidden Pitfalls of the Cosine Similarity Loss

Class-Incremental Learning Based on Big Dataset Pre-Trained Models

Reaching Nirvana: Maximizing the Margin in Both Euclidean and Angular Spaces for Deep Neural Network Classification

OSLNet: Deep Small-Sample Classification with an Orthogonal Softmax Layer

Cosmological model discrimination with Deep Learning

B-cosification: Transforming Deep Neural Networks to be Inherently Interpretable

Hybridized sine cosine algorithm with convolutional neural networks dropout regularization application

Can we learn better with hard samples?

COSCO: A Sharpness-Aware Training Framework for Few-shot Multivariate Time Series Classification

Towards Understanding Deep Learning from Noisy Labels with Small-Loss Criterion

How Small is Big Enough? Open Labeled Datasets and the Development of Deep Learning

Novel Loss Function in CNN for Small Sample Target Recognition in SAR Images

Matthews Correlation Coefficient Loss for Deep Convolutional Networks: Application to Skin Lesion Segmentation

On the Learning Property of Logistic and Softmax Losses for Deep Neural Networks

Single Model Deep Learning on Imbalanced Small Datasets for Skin Lesion Classification

Research on the deep learning of the small sample data based on transfer learning

Scaling Down Deep Learning with MNIST-1D

A Small Sample Face Recognition Method Based on Deep Learning