Abstract:A deep neural network is suitable for remote sensing image pixel-wise classification because it effectively extracts features from the raw data. However, remote sensing images with higher spatial resolution exhibit smaller inter-class differences and greater intra-class differences; thus, feature extraction becomes more difficult. The attention mechanism, as a method that simulates the manner in which humans comprehend and perceive images, is useful for the quick and accurate acquisition of key features. In this study, we propose a novel neural network that incorporates two kinds of attention mechanisms in its mask and trunk branches; i.e., control gate (soft) and feedback attention mechanisms, respectively, based on the branches’ primary roles. Thus, a deep neural network can be equipped with an attention mechanism to perform pixel-wise classification for very high-resolution remote sensing (VHRRS) images. The control gate attention mechanism in the mask branch is utilized to build pixel-wise masks for feature maps, to assign different priorities to different locations on different channels for feature extraction recalibration, to apply stress to the effective features, and to weaken the influence of other profitless features. The feedback attention mechanism in the trunk branch allows for the retrieval of high-level semantic features. Hence, additional aids are provided for lower layers to re-weight the focus and to re-update higher-level feature extraction in a target-oriented manner. These two attention mechanisms are fused to form a neural network module. By stacking various modules with different-scale mask branches, the network utilizes different attention-aware features under different local spatial structures. The proposed method is tested on the VHRRS images from the BJ-02, GF-02, Geoeye, and Quickbird satellites, and the influence of the network structure and the rationality of the network design are discussed. Compared with other state-of-the-art methods, our proposed method achieves competitive accuracy, thereby proving its effectiveness.

Attention-aware Perceptual Enhancement Nets for Low-Resolution Image Classification

Toward Robust and Efficient Low-Light Image Enhancement: Progressive Attentive Retinex Architecture Search

Rethinking Low-Level Features for Interest Point Detection and Description.

An Augmentation Attention Mechanism for High-Spatial-Resolution Remote Sensing Image Scene Classification

Low-Illumination Image Enhancement Based on End-to-End Network Using Attention Module

NLRNet: An Efficient Nonlocal Attention ResNet for Pansharpening

Attention-Mechanism-Containing Neural Networks for High-Resolution Remote Sensing Image Classification

Attention-based cropping and erasing learning with coarse-to-fine refinement for fine-grained visual classification

Combining Attention Mechanism and Retinex Model to Enhance Low-Light Images

An Improved Retinex-Based Approach Based on Attention Mechanisms for Low-Light Image Enhancement

Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentation

AMBCR: Low-light Image Enhancement Via Attention Guided Multi-Branch Construction and Retinex Theory

Low-light Enhancement Method Based on Attention Map Net

Attention Based Residual Network For High-Resolution Remote Sensing Imagery Scene Classification

Attention Based Network for Remote Sensing Scene Classification.

A novel attention-enhanced network for image super-resolution

A Deep Retinex-Based Low-Light Enhancement Network Fusing Rich Intrinsic Prior Information

Discriminative Feature Mining and Enhancement Network for Low-resolution Fine-grained Image Recognition

Attention-Guided Label Refinement Network For Semantic Segmentation Of Very High Resolution Aerial Orthoimages

End-to-End Retinex-Based Illumination Attention Low-Light Enhancement Network for Autonomous Driving at Night

Attention-Based Network for Low-Light Image Enhancement