Abstract:In recent years, the use of deep neural network in effective network feature extraction and the design of efficient and high-precision hyperspectral image classification algorithms has gradually become a research hotspot for scholars. However, due to the difficulty of obtaining hyperspectral images and the high cost of annotation, the training samples are very limited. In order to cope with the small sample problem, researchers often deepen the network model and use the attention mechanism to extract features; however, as the network model continues to deepen, the gradient disappears, the feature extraction ability is insufficient, and the computational cost is high. Therefore, how to make full use of the spectral and spatial information in limited samples has gradually become a difficult problem. In order to cope with such problems, this paper proposes two-branch multiscale spatial–spectral feature aggregation with a self-attention mechanism for a hyperspectral image classification model (FHDANet); the model constructs a dense two-branch pyramid structure, which can achieve the high efficiency extraction of joint spatial–spectral feature information and spectral feature information, reduce feature loss to a large extent, and strengthen the model's ability to extract contextual information. A channel–space attention module, ECBAM, is proposed, which greatly improves the extraction ability of the model for salient features, and a spatial information extraction module based on the deep feature fusion strategy HLDFF is proposed, which fully strengthens feature reusability and mitigates the feature loss problem brought about by the deepening of the model. Compared with five hyperspectral image classification algorithms, SVM, SSRN, A2S2K-ResNet, HyBridSN, SSDGL, RSSGL and LANet, this method significantly improves the classification performance on four representative datasets. Experiments have demonstrated that FHDANet can better extract and utilise the spatial and spectral information in hyperspectral images with excellent classification performance under small sample conditions.

Lightweight Self-attention Residual Network for Hyperspectral Classification

A lightweight and stochastic depth residual attention network for remote sensing scene classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Computationally Lightweight Hyperspectral Image Classification Using a Multiscale Depthwise Convolutional Network With Channel Attention

Hyperspectral Images Classification Based on Multi-scale Residual Network

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

Active Deep Densely Connected Convolutional Network for Hyperspectral Image Classification

LiteDepthwiseNet: An Extreme Lightweight Network for Hyperspectral Image Classification

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

Hyperspectral Image Classification with a Dense Multi-Scale Residual Network

An attention involved network stacked by dual-channel residual block for hyperspectral image classification

Lightweight Tensor Attention-Driven ConvLSTM Neural Network for Hyperspectral Image Classification

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Deep Convolutional Neural Networks for Hyperspectral Image Classification

Classification of Hyperspectral Imagery Using a New Fully Convolutional Neural Network

SPECTRAL-SPATIAL MULTISCALE RESIDUAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION

A New Dual-Branch Embedded Multivariate Attention Network for Hyperspectral Remote Sensing Classification

Hyperspectral Image Classification Based on Two-Branch Multiscale Spatial Spectral Feature Fusion with Self-Attention Mechanisms

A Depthwise Separable Fully Convolutional ResNet With ConvCRF for Semisupervised Hyperspectral Image Classification

An Ultralightweight Hybrid CNN Based on Redundancy Removal for Hyperspectral Image Classification

Hyperspectral Image Classification Based on a 3D Octave Convolution and 3D Multiscale Spatial Attention Network