Abstract:A deep neural network is suitable for remote sensing image pixel-wise classification because it effectively extracts features from the raw data. However, remote sensing images with higher spatial resolution exhibit smaller inter-class differences and greater intra-class differences; thus, feature extraction becomes more difficult. The attention mechanism, as a method that simulates the manner in which humans comprehend and perceive images, is useful for the quick and accurate acquisition of key features. In this study, we propose a novel neural network that incorporates two kinds of attention mechanisms in its mask and trunk branches; i.e., control gate (soft) and feedback attention mechanisms, respectively, based on the branches’ primary roles. Thus, a deep neural network can be equipped with an attention mechanism to perform pixel-wise classification for very high-resolution remote sensing (VHRRS) images. The control gate attention mechanism in the mask branch is utilized to build pixel-wise masks for feature maps, to assign different priorities to different locations on different channels for feature extraction recalibration, to apply stress to the effective features, and to weaken the influence of other profitless features. The feedback attention mechanism in the trunk branch allows for the retrieval of high-level semantic features. Hence, additional aids are provided for lower layers to re-weight the focus and to re-update higher-level feature extraction in a target-oriented manner. These two attention mechanisms are fused to form a neural network module. By stacking various modules with different-scale mask branches, the network utilizes different attention-aware features under different local spatial structures. The proposed method is tested on the VHRRS images from the BJ-02, GF-02, Geoeye, and Quickbird satellites, and the influence of the network structure and the rationality of the network design are discussed. Compared with other state-of-the-art methods, our proposed method achieves competitive accuracy, thereby proving its effectiveness.

The Hierarchical Hybrid Fuzzy-Neural Network Based on Lasso Function and Its Application to Classification of Remote Sensing Images

Hhfnn Based on Lasso Function and Its Application in Remote Sensing Image Classification

Fuzzy Neural Network Based on Hybrid Learning Algorithm and Its Application to Soft Sensor

Remote Sensing Images Classification in the City Based on Primary Component Analysis and Fuzzy Neural Network

Remote Sensing Image Classification Based On Fuzzy Gauss Function Neural Network

Remote sensing images classification using fuzzy B-spline function neural network

Neural Network Classification with Optimization by Genetic Algorithms for Remote Sensing Imagery

An Image Segmentation Approach Based on Fuzzy-Neural-network Hybrid System

An Application of Neuro-fuzzy System in Remote Sensing Image Classification

Superpixel-Based Long-Range Dependent Network for High-Resolution Remote-Sensing Image Classification

High Resolution Remote Sensing Image Classification Combining with Mean-Shift Segmentation and Fully Convolution Neural Network

Sensitivity Analysis of Hierarchical Hybrid Fuzzy - Neural Network

Attention-Mechanism-Containing Neural Networks for High-Resolution Remote Sensing Image Classification

Remote sensing images classification using fuzzy-rough neural network.

A Novel Adaptive Hybrid Fusion Network for Multiresolution Remote Sensing Images Classification

A Hybrid convolution neural network for the classification of tree species using hyperspectral imagery

The Application of Improved Fuzzy ARTMAP Neural Network in Remote Sensing Classification of Land-use

A Hybrid mutli-hierarchical classification based on an improved optimal segmentation parameter for high resolution remote sensing image

Spatial Sequential Recurrent Neural Network for Hyperspectral Image Classification

Land Cover Classification of Remote Sensing Imagery with Hybrid Two-Layer Attention Network Architecture