Abstract:Hyperspectral images (HSIs) encapsulate a vast amount of information due to their expansive size and high number of channel dimensions. However, they are insufficiently utilized for ineffective feature extraction, particularly for regions with few samples and predominant edges. To fully leverage the spatial–spectral features of HSIs, a dual-branch multi-scale spatial–spectral residual attention network (MSRAN) that integrates multi-scale feature extraction with residual attention mechanisms is proposed. MSRAN independently extracts spatial and spectral features through dual branches, minimizing the interference between these features and enhancing the focus on feature extraction in different dimensions. Specifically, in the spectral feature extraction branch, diverse-scale 3D convolution kernels capture extended spectral sequence characteristics and neighborhood spectral features. The convolution fusion emphasizes the weight of the central pixel to be classified, followed by the use of spectral residual attention mechanisms to extract enhanced central-pixel spectral features. In the spatial feature extraction branch, multi-level receptive fields are utilized to extract various fine-grained spatial contours, edges, and local detailed features, which are further processed through spatial residual attention to effectively extract spatial composite features. Finally, the convolution fusion module adaptively integrates the center-enhanced spectral features with multi-level fine-grained spatial features for classification. Extensive comparative experiments and ablation studies demonstrate that MSRAN achieves highly competitive results on two classic datasets from Pavia University and Salinas as well as on a novel dataset of WHU-Hi-LongKou.

An attention involved network stacked by dual-channel residual block for hyperspectral image classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Lightweight Self-attention Residual Network for Hyperspectral Classification

The real-time and stack fusion enhanced dual-channel network with attention modules for fast hyperspectral image classification

Hyperspectral Images Classification Based on Multi-scale Residual Network

A Cross-Channel Dense Connection and Multi-Scale Dual Aggregated Attention Network for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

Hyperspectral Image Classification with a Dense Multi-Scale Residual Network

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

A Triple-Path Spectral–Spatial Network With Interleave-Attention for Hyperspectral Image Classification

Hyperspectral Image Classification Using Spectral–Spatial Double-Branch Attention Mechanism

Multi-Scale Spatial–Spectral Residual Attention Network for Hyperspectral Image Classification

Research on image classification based on residual group multi-scale enhanced attention network

Dual-Branch Attention-Assisted CNN for Hyperspectral Image Classification

The Classification of Hyperspectral Images: A Double-Branch Multi-Scale Residual Network

Computationally Lightweight Hyperspectral Image Classification Using a Multiscale Depthwise Convolutional Network With Channel Attention

Channel-Attention-Based DenseNet Network for Remote Sensing Image Scene Classification

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

DSSFN: A Dual-Stream Self-Attention Fusion Network for Effective Hyperspectral Image Classification

Multiscale Spatial-Spectral Feature Extraction Network for Hyperspectral Image Classification