Abstract:Due to its wide applications, remote sensing (RS) image scene classification has attracted increasing research interest. When each category has a sufficient number of labeled samples, RS image scene classification can be well addressed by deep learning. However, in the RS big data era, it is extremely difficult or even impossible to annotate RS scene samples for all the categories in one time as the RS scene classification often needs to be extended along with the emergence of new applications that inevitably involve a new class of RS images. Hence, the RS big data era fairly requires a zeroshot RS scene classification (ZSRSSC) paradigm in which the classification model learned from training RS scene categories obeys the inference ability to recognize the RS image scenes from unseen categories, in common with the humans' evolutionary perception ability. Unfortunately, zero-shot classification is largely unexploited in the RS field. This article proposes a novel ZSRSSC method based on locality-preservation deep cross-modal embedding networks (LPDCMENs). The proposed LPDCMENs, which can fully assimilate the pairwise intramodal and intermodal supervision in an end-to-end manner, aim to alleviate the problem of class structure inconsistency between two hybrid spaces (i.e., the visual image space and the semantic space). To pursue a stable and generalization ability, which is highly desired for ZSRSSC, a set of explainable constraints is specially designed to optimize LPDCMENs. To fully verify the effectiveness of the proposed LPDCMENs, we collect a new large-scale RS scene data set, including the instance-level visual images and class-level semantic representations (RSSDIVCS), where the general and domain knowledge is exploited to construct the class-level semantic representations. Extensive experiments show that the proposed ZSRSSC method based on LPDCMENs can obviously outperform the state-of-the-art methods, and the domain knowledge further improves the performance of ZSRSSC compared with the general knowledge. The collected RSSDIVCS will be made publicly available along with this article.

Zero-Shot Scene Classification for High Spatial Resolution Remote Sensing Images

Zero-shot scene classification for high spatial resolution remote sensing images

Zero-Shot Detection with Transferable Object Proposal Mechanism.

Zero-shot Remote Sensing Image Scene Classification Based on Robust Cross-Domain Mapping and Gradual Refinement of Semantic Space

Review of Zero-Shot Remote Sensing Image Scene Classification

Weakly Supervised Classification Model for Zero‐shot Semantic Segmentation

Deep Semantic-Visual Alignment for Zero-Shot Remote Sensing Image Scene Classification

An Optical Image-Aided Approach for Zero-Shot SAR Image Scene Classification

A Distance-Constrained Semantic Autoencoder for Zero-Shot Remote Sensing Scene Classification

Transformer-Based Approach Via Contrastive Learning for Zero-Shot Detection.

Learning Deep Cross-Modal Embedding Networks for Zero-Shot Remote Sensing Image Scene Classification

Text guided zero-shot scene classification of high spatial resolution remote sensing images

Zero-Shot Remote Sensing Scene Classification Based on Automatic Knowledge Graph and Dual-Branch Semantic Correlation Supervision

Zero Shot Objects Classification Method of Side Scan Sonar Image Based on Synthesis of Pseudo Samples

Zero-Shot Image Classification Method Based on Attention Mechanism and Semantic Information Fusion

See More and Know More: Zero-shot Point Cloud Segmentation via Multi-modal Visual Data

Zero-Shot Remote Sensing Scene Classification Method Based on Local-Global Feature Fusion and Weight Mapping Loss

Zero-shot Recognition with Latent Visual Attributes Learning.

Zero-Shot Learning with Few Seen Class Samples.

Recognizing Unknown Disaster Scenes with Knowledge Graph-based Zero-Shot Learning (KG-ZSL) Model

Zero-shot Object Detection with Contrastive Semantic Association Network