Abstract:The core purpose of deep metric learning is to construct an embedding space, where objects belonging to the same class are gathered together and the ones from different classes are pushed apart. Most existing approaches typically insist to inter-class characteristics, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">e.g.</i> , class-level information or instance-level similarity, to obtain semantic relevance of data points and get a large margin between different classes in the embedding space. However, the intra-class characteristics, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">e.g.</i> , local manifold structure or relative relationship within the same class, are usually overlooked in the learning process. Hence the output embeddings have limitation in retrieving a good ranking result if existing multiple positive samples. And the local data structure of embedding space cannot be fully exploited since lack of relative ranking information. As a result, the model is prone to overfitting on a train set and get low generalization on the test set (unseen classes) when losing sight of intra-class variance. This paper presents a novel self-supervised synthesis ranking auxiliary framework, which captures intra-class characteristics as well as inter-class characteristics for better metric learning. Our method designs a synthetic samples generation of polar coordinates to generate measurable intra-class variance with different strength and diversity in the latent space, which can simulate the various local structure change of intra-class in the initial data domain. And then formulates a self-supervised learning procedure to fully exploit this property and preserve it in the embedding space. As a result, the learned embedding space not only keeps inter-class discrimination but also owns subtle intra-class diversity, leading to better global and local embedding structures. Extensive experiments on five benchmarks show that our method significantly improves and outperforms the state-of-the-art methods on the performances of both retrieval and ranking by 2%-4% (personal use of this material is permitted. However, permission to use this material for any other purposes must be obtained from the IEEE by sending an email to pubs-permissions@ieee.org).

Deep Metric Learning using Similarities from Nonlinear Rank Approximations

Ranked List Loss for Deep Metric Learning

DarkRank: Accelerating Deep Metric Learning via Cross Sample Similarities Transfer

Deep Metric Learning with Self-Supervised Ranking.

Deep Nonlinear Metric Learning for 3-D Shape Retrieval

Measuring similarity between embedding spaces using induced neighborhood graphs

Learning Deep Optimal Embeddings with Sinkhorn Divergences

Deep Multimetric Learning for Shape-Based 3D Model Retrieval

Learning Non-Metric Partial Similarity Based on Maximal Margin Criterion

Deep Localized Metric Learning.

Signal-To-Noise Ratio: A Robust Distance Metric For Deep Metric Learning

Deep Metric Learning for Computer Vision: A Brief Overview

Semantic Discriminative Metric Learning for Image Similarity Measurement

Self-Supervised Synthesis Ranking for Deep Metric Learning

Deep Metric Learning Assisted by Intra-variance in A Semi-supervised View of Learning

Metric Learning Via Penalized Optimization.

A New Similarity Space Tailored for Supervised Deep Metric Learning

Deep Compositional Metric Learning

Deep Relational Metric Learning.

Differential Geometric Retrieval of Deep Features