Abstract:Deep neural networks have achieved promising progress in remote sensing (RS) image classification, for which the training process requires abundant samples for each class. However, it is time-consuming and unrealistic to annotate labels for each RS category, given the fact that the RS target database is increasing dynamically. Zero-shot learning (ZSL) allows for identifying novel classes that are not seen during training, which provides a promising solution for the aforementioned problem. However, previous ZSL models mainly depend on manually-labeled attributes or word embeddings extracted from language models to transfer knowledge from seen classes to novel classes. Besides, pioneer ZSL models use convolutional neural networks pre-trained on ImageNet, which focus on the main objects appearing in each image, neglecting the background context that also matters in RS scene classification. To address the above problems, we propose to collect visually detectable attributes automatically. We predict attributes for each class by depicting the semantic-visual similarity between attributes and images. In this way, the attribute annotation process is accomplished by machine instead of human as in other methods. Moreover, we propose a Deep Semantic-Visual Alignment (DSVA) that take advantage of the self-attention mechanism in the transformer to associate local image regions together, integrating the background context information for prediction. The DSVA model further utilizes the attribute attention maps to focus on the informative image regions that are essential for knowledge transfer in ZSL, and maps the visual images into attribute space to perform ZSL classification. With extensive experiments, we show that our model outperforms other state-of-the-art models by a large margin on a challenging large-scale RS scene classification benchmark.

Zero-Shot SAR Target Recognition Based on Classification Assistance

EM Simulation-Aided Zero-Shot Learning for SAR Automatic Target Recognition

Learn to Recognize Unknown SAR Targets From Reflection Similarity

Zero-Shot SAR Target Recognition Based on a Conditional Generative Network with Category Features from Simulated Images

Generalized Zero-Shot Recognition of SAR Target via Conditional Disentangled Learning

Target Representation and Classification with Limited Data in Synthetic Aperture Radar Images

Zero-Shot Learning of SAR Target Feature Space with Deep Generative Neural Networks.

Feature Generation-Aided Zero-Shot Fast SAR Target Recognition With Semantic Attributes

Zero-Shot Learning via Discriminative Dual Semantic Auto-Encoder

Learning to Generate SAR Images With Adversarial Autoencoder

Deep Semantic-Visual Alignment for Zero-Shot Remote Sensing Image Scene Classification

Capsule Broad Learning System Network for Robust Synthetic Aperture Radar Automatic Target Recognition with Small Samples

Azimuth-Aware Discriminative Representation Learning for Semi-Supervised Few-Shot SAR Vehicle Recognition

Simulation-Aided SAR Target Classification via Dual-Branch Reconstruction and Subdomain Alignment

Learning adversarial semantic embeddings for zero-shot recognition in open worlds

A Novel Category Discovery Method for SAR Images Based on an Improved UNO Framework

Learning Efficient Representations for Enhanced Object Detection on Large-scene SAR Images

Zero-shot learning via visual feature enhancement and dual classifier learning for image recognition

A novel few-shot learning method for synthetic aperture radar image recognition

Convolutional Neural Network With Attention Mechanism for SAR Automatic Target Recognition

Adaptive Relation-Aware Network for zero-shot classification