Abstract:With the development of convolutional neural networks (CNNs), the semantic understanding of remote sensing (RS) scenes has been significantly improved based on their prominent feature encoding capabilities. While many existing deep-learning models focus on designing different architectures, only a few works in the RS field have focused on investigating the performance of the learned feature embeddings and the associated metric space. In particular, two main loss functions have been exploited: the contrastive and the triplet loss. However, the straightforward application of these techniques to RS images may not be optimal in order to capture their neighborhood structures in the metric space due to the insufficient sampling of image pairs or triplets during the training stage and to the inherent semantic complexity of remotely sensed data. To solve these problems, we propose a new deep metric learning approach, which overcomes the limitation on the class discrimination by means of two different components: 1) scalable neighborhood component analysis (SNCA) that aims at discovering the neighborhood structure in the metric space and 2) the cross-entropy loss that aims at preserving the class discrimination capability based on the learned class prototypes. Moreover, in order to preserve feature consistency among all the minibatches during training, a novel optimization mechanism based on momentum update is introduced for minimizing the proposed loss. An extensive experimental comparison (using several state-of-the-art models and two different benchmark data sets) has been conducted to validate the effectiveness of the proposed method from different perspectives, including: 1) classification; 2) clustering; and 3) image retrieval. The related codes of this article will be made publicly available for reproducible research by the community.

Hyperspectral Imagery Classification with Deep Metric Learning

Discriminative Cnn Via Metric Learning For Hyperspectral Classification

Deep Metric Learning-Based Feature Embedding for Hyperspectral Image Classification

Hyperspectral Image Classification with Deep Metric Learning and Conditional Random Field

Hashing-Based Deep Metric Learning for the Classification of Hyperspectral and LiDAR Data

Probabilistic Deep Metric Learning for Hyperspectral Image Classification

High-Rankness Regularized Semi-Supervised Deep Metric Learning for Remote Sensing Imagery

Deep Metric Learning Based on Scalable Neighborhood Components for Remote Sensing Scene Characterization

Dimensionality Reduction and Classification of Hyperspectral Images Using Ensemble Discriminative Local Metric Learning.

Hyperspectral Image Classification Using One Dimensional Manifold Embedding with Spectral-Spatial Based Affinity Metric

A Multi-Label Hyperspectral Image Classification Method with Deep Learning Features.

Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification

Hyperspectral Image Classification With Deep Learning Models

Target Detection With Spatial-Spectral Adaptive Sample Generation and Deep Metric Learning for Hyperspectral Imagery

HYPERSPECTRAL IMAGE CLASSIFICATION BASED ON DIFFERENT AFFINITY METRICS

Deep Learning for Hyperspectral Image Classification: An Overview

Deep Learning Integrated with Multiscale Pixel and Object Features for Hyperspectral Image Classification

Hyperspectral Classification Via Learnt Features

Deep Learning-Based Classification of Hyperspectral Data

SSMD: Dimensionality Reduction and Classification of Hyperspectral Images Based on Spatial–Spectral Manifold Distance Metric Learning

A CNN With Multiscale Convolution and Diversified Metric for Hyperspectral Image Classification