Abstract:With the development of convolutional neural networks (CNNs), the semantic understanding of remote sensing (RS) scenes has been significantly improved based on their prominent feature encoding capabilities. While many existing deep-learning models focus on designing different architectures, only a few works in the RS field have focused on investigating the performance of the learned feature embeddings and the associated metric space. In particular, two main loss functions have been exploited: the contrastive and the triplet loss. However, the straightforward application of these techniques to RS images may not be optimal in order to capture their neighborhood structures in the metric space due to the insufficient sampling of image pairs or triplets during the training stage and to the inherent semantic complexity of remotely sensed data. To solve these problems, we propose a new deep metric learning approach, which overcomes the limitation on the class discrimination by means of two different components: 1) scalable neighborhood component analysis (SNCA) that aims at discovering the neighborhood structure in the metric space and 2) the cross-entropy loss that aims at preserving the class discrimination capability based on the learned class prototypes. Moreover, in order to preserve feature consistency among all the minibatches during training, a novel optimization mechanism based on momentum update is introduced for minimizing the proposed loss. An extensive experimental comparison (using several state-of-the-art models and two different benchmark data sets) has been conducted to validate the effectiveness of the proposed method from different perspectives, including: 1) classification; 2) clustering; and 3) image retrieval. The related codes of this article will be made publicly available for reproducible research by the community.

Learning Local Feature Descriptors with Quadruplet Ranking Loss

Discriminatively Learning for Representing Local Image Features with Quadruplet Model

Learning Local Feature Descriptors Through Ranking Losses Improved by Variance Shrinkage

A Deep Quadruplet Network for Local Descriptor Learning

Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions

Robust Angular Local Descriptor Learning

Local Image Descriptors with Statistical Losses

DHNet: Working Double Hard to Learn a Convolutional Neural Network-Based Local Descriptor

Deep Quadruplet Network For Hyperspectral Image Classification With A Small Number Of Samples

Working hard to know your neighbor's margins: Local descriptor learning loss

Quadruplet Network with One-Shot Learning for Fast Visual Object Tracking

STCDesc: Learning Deep Local Descriptor Using Similar Triangle Constraint

Deep Metric Learning Based on Scalable Neighborhood Components for Remote Sensing Scene Characterization

Hierarchical Quadruplet Net for Deep Metric Learning and Network Regularization

Local Quadruple Pattern: A Novel Descriptor for Facial Image Recognition and Retrieval

Learning Quintuplet Loss for Large-scale Visual Geo-Localization

Jointly Learning Shape Descriptors and Their Correspondence Via Deep Triplet CNNs

Neighborhood Watch: Representation Learning with Local-Margin Triplet Loss and Sampling Strategy for K-Nearest-Neighbor Image Classification

Kernelized Subspace Pooling for Deep Local Descriptors.

TCDesc: Learning Topology Consistent Descriptors for Image Matching

Learning local descriptors with multi-level feature aggregation and spatial context pyramid