Abstract:With the development of convolutional neural networks (CNNs), the semantic understanding of remote sensing (RS) scenes has been significantly improved based on their prominent feature encoding capabilities. While many existing deep-learning models focus on designing different architectures, only a few works in the RS field have focused on investigating the performance of the learned feature embeddings and the associated metric space. In particular, two main loss functions have been exploited: the contrastive and the triplet loss. However, the straightforward application of these techniques to RS images may not be optimal in order to capture their neighborhood structures in the metric space due to the insufficient sampling of image pairs or triplets during the training stage and to the inherent semantic complexity of remotely sensed data. To solve these problems, we propose a new deep metric learning approach, which overcomes the limitation on the class discrimination by means of two different components: 1) scalable neighborhood component analysis (SNCA) that aims at discovering the neighborhood structure in the metric space and 2) the cross-entropy loss that aims at preserving the class discrimination capability based on the learned class prototypes. Moreover, in order to preserve feature consistency among all the minibatches during training, a novel optimization mechanism based on momentum update is introduced for minimizing the proposed loss. An extensive experimental comparison (using several state-of-the-art models and two different benchmark data sets) has been conducted to validate the effectiveness of the proposed method from different perspectives, including: 1) classification; 2) clustering; and 3) image retrieval. The related codes of this article will be made publicly available for reproducible research by the community.

A Framework for Metric Learning and Embedding with Topology Learning Neural Networks

A Gaussian Mixture Framework for Incremental Nonparametric Regression with Topology Learning Neural Networks

Topology2Vec: Topology Representation Learning for Data Center Networking

Nonparametric kernel smoother on topology learning neural networks for incremental and ensemble regression

Deep Metric Learning Based on Scalable Neighborhood Components for Remote Sensing Scene Characterization

Metric networks for enhanced perception of non-local semantic information

TPNE: Topology Preserving Network Embedding.

Cross-modal Metric Learning with Graph Embedding.

A Method for Metric Learning with Multiple-Kernel Embedding

TopoLa: a novel embedding framework for understanding complex networks

An Optimal Transport Approach to Deep Metric Learning (student Abstract)

Characterizing the Influence of Topology on Graph Learning Tasks

A Topology-Cognitive Algorithm Framework for Virtual Network Embedding Problem

A Unified Framework for Metric Transfer Learning.

Novel Online Dimensionality Reduction Method with Improved Topology Representing and Radial Basis Function Networks

Neighborhood-Adaptive Structure Augmented Metric Learning

A Novel Metric Learning Framework by Exploiting Global and Local Information

Topology Learning Embedding: A Fast and Incremental Method for Manifold Learning

An Incremental Network for On-Line Unsupervised Classification and Topology Learning.

Gaussian Kernel Smooth Regression with Topology Learning Neural Networks and Python Implementation.

A Local Similarity-Preserving Framework for Nonlinear Dimensionality Reduction with Neural Networks