Abstract:In recent years, the use of deep neural network in effective network feature extraction and the design of efficient and high-precision hyperspectral image classification algorithms has gradually become a research hotspot for scholars. However, due to the difficulty of obtaining hyperspectral images and the high cost of annotation, the training samples are very limited. In order to cope with the small sample problem, researchers often deepen the network model and use the attention mechanism to extract features; however, as the network model continues to deepen, the gradient disappears, the feature extraction ability is insufficient, and the computational cost is high. Therefore, how to make full use of the spectral and spatial information in limited samples has gradually become a difficult problem. In order to cope with such problems, this paper proposes two-branch multiscale spatial–spectral feature aggregation with a self-attention mechanism for a hyperspectral image classification model (FHDANet); the model constructs a dense two-branch pyramid structure, which can achieve the high efficiency extraction of joint spatial–spectral feature information and spectral feature information, reduce feature loss to a large extent, and strengthen the model's ability to extract contextual information. A channel–space attention module, ECBAM, is proposed, which greatly improves the extraction ability of the model for salient features, and a spatial information extraction module based on the deep feature fusion strategy HLDFF is proposed, which fully strengthens feature reusability and mitigates the feature loss problem brought about by the deepening of the model. Compared with five hyperspectral image classification algorithms, SVM, SSRN, A2S2K-ResNet, HyBridSN, SSDGL, RSSGL and LANet, this method significantly improves the classification performance on four representative datasets. Experiments have demonstrated that FHDANet can better extract and utilise the spatial and spectral information in hyperspectral images with excellent classification performance under small sample conditions.

R-VCANet: A New Deep-Learning-Based Hyperspectral Image Classification Method

Residual Deep PCA-based Feature Extraction for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Two-Branch Multiscale Spatial Spectral Feature Fusion with Self-Attention Mechanisms

A New Dataset and Deep Residual Spectral Spatial Network for Hyperspectral Image Classification

Lightweight 3D Dense Autoencoder Network for Hyperspectral Remote Sensing Image Classification

A combination method of stacked autoencoder and 3D deep residual network for hyperspectral image classification

H-RNet: Hybrid Relation Network for Few-Shot Learning-Based Hyperspectral Image Classification

Hyperspectral image classification based on spectral and spatial information using ResNet with channel attention

Efficient Deep Learning of Non-local Features for Hyperspectral Image Classification

Lightweight-VGG: A Fast Deep Learning Architecture Based on Dimensionality Reduction and Nonlinear Enhancement for Hyperspectral Image Classification

Efficient Deep Learning of Nonlocal Features for Hyperspectral Image Classification

Spectral–Spatial Classification of Few Shot Hyperspectral Image With Deep 3-D Convolutional Random Fourier Features Network

Wide and Deep Fourier Neural Network for Hyperspectral Remote Sensing Image Classification

Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Spatial Attention Guided Residual Attention Network for Hyperspectral Image Classification

Heterogeneous Spectral-Spatial Network with 3D Attention and MLP for Hyperspectral Image Classification Using Limited Training Samples

Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks

Multiscale Densely Connected Attention Network for Hyperspectral Image Classification

Three-dimensional Densely Connected Convolutional Network for Hyperspectral Remote Sensing Image Classification

Attention Mechanism and Depthwise Separable Convolution Aided 3DCNN for Hyperspectral Remote Sensing Image Classification