Abstract:With the development of convolutional neural networks (CNNs), the semantic understanding of remote sensing (RS) scenes has been significantly improved based on their prominent feature encoding capabilities. While many existing deep-learning models focus on designing different architectures, only a few works in the RS field have focused on investigating the performance of the learned feature embeddings and the associated metric space. In particular, two main loss functions have been exploited: the contrastive and the triplet loss. However, the straightforward application of these techniques to RS images may not be optimal in order to capture their neighborhood structures in the metric space due to the insufficient sampling of image pairs or triplets during the training stage and to the inherent semantic complexity of remotely sensed data. To solve these problems, we propose a new deep metric learning approach, which overcomes the limitation on the class discrimination by means of two different components: 1) scalable neighborhood component analysis (SNCA) that aims at discovering the neighborhood structure in the metric space and 2) the cross-entropy loss that aims at preserving the class discrimination capability based on the learned class prototypes. Moreover, in order to preserve feature consistency among all the minibatches during training, a novel optimization mechanism based on momentum update is introduced for minimizing the proposed loss. An extensive experimental comparison (using several state-of-the-art models and two different benchmark data sets) has been conducted to validate the effectiveness of the proposed method from different perspectives, including: 1) classification; 2) clustering; and 3) image retrieval. The related codes of this article will be made publicly available for reproducible research by the community.

Self-weighted Discriminative Metric Learning Based on Deep Features for Scene Recognition

Class-specific discriminative metric learning for scene recognition

Deep Metric Learning Based on Scalable Neighborhood Components for Remote Sensing Scene Characterization

Deep feature fusion through adaptive discriminative metric learning for scene recognition

Deep Metric Learning For Scene Text Detection

When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs

High-Rankness Regularized Semi-Supervised Deep Metric Learning for Remote Sensing Imagery

Embedding metric learning into an extreme learning machine for scene recognition

Robust local metric learning via least square regression regularization for scene recognition

Semantic Discriminative Metric Learning for Image Similarity Measurement

Scalable Angular Discriminative Deep Metric Learning for Face Recognition

Depth from Defocus Via Discriminative Metric Learning

Few-Shot Remote Sensing Image Scene Classification Based on Metric Learning and Local Descriptors

Self-Weighted Multi-View Metric Learning and Its Application for Remote Sensing Image Scene Classification

Exponential Discriminative Metric Embedding in Deep Learning

Weakly Supervised Deep Metric Learning for Community-Contributed Image Retrieval

Joint global metric learning and local manifold preservation for scene recognition

Signal-To-Noise Ratio: A Robust Distance Metric For Deep Metric Learning

Denoising Multi-Similarity Formulation: A Self-Paced Curriculum-Driven Approach for Robust Metric Learning

Discriminative Deep Metric Learning for Face Verification in the Wild