Abstract:The convolutional neural network (CNN) method has been widely used in the classification of hyperspectral images (HSIs). However, the efficiency and accuracy of the HSI classification are inevitably degraded when small samples are available. This study proposes a multidimensional CNN model named MDAN, which is constructed with an attention mechanism, to achieve an ideal classification performance of CNN within the framework of few-shot learning. In this model, a three-dimensional (3D) convolutional layer is carried out for obtaining spatial–spectral features from the 3D volumetric data of HSI. Subsequently, the two-dimensional (2D) and one-dimensional (1D) convolutional layers further learn spatial and spectral features efficiently at an abstract level. Based on the most widely used convolutional block attention module (CBAM), this study investigates a convolutional block self-attention module (CBSM) to improve accuracy by changing the connection ways of attention blocks. The CBSM model is used with the 2D convolutional layer for better performance of HSI classification purposes. The MDAN model is applied for classification applications using HSI, and its performance is evaluated by comparing the results with the support vector machine (SVM), 2D CNN, 3D CNN, 3D–2D–1D CNN, and CBAM. The findings of this study indicate that classification results from the MADN model show overall classification accuracies of 97.34%, 96.43%, and 92.23% for Salinas, WHU-Hi-HanChuan, and Pavia University datasets, respectively, when only 1% HSI data were used for training. The training and testing times of the MDAN model are close to those of the 3D–2D–1D CNN, which has the highest efficiency among all comparative CNN models. The attention model CBSM is introduced into MDAN, which achieves an overall accuracy of about 1% higher than that of the CBAM model. The performance of the two proposed methods is superior to the other models in terms of both efficiency and accuracy. The results show that the combination of multidimensional CNNs and attention mechanisms has the best ability for small-sample problems in HSI classification.

Heterogeneous Spectral-Spatial Network with 3D Attention and MLP for Hyperspectral Image Classification Using Limited Training Samples

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Hyperspectral image classification based on multiscale piecewise spectral-spatial attention network

3-D Channel and Spatial Attention Based Multiscale Spatial-Spectral Residual Network for Hyperspectral Image Classification

Residual Spectral–Spatial Attention Network for Hyperspectral Image Classification

Attention Mechanism and Depthwise Separable Convolution Aided 3DCNN for Hyperspectral Remote Sensing Image Classification

Spatial–Spectral Feature Refinement for Hyperspectral Image Classification Based on Attention-Dense 3D-2D-CNN

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Attention-based Multi-Scale Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

Attention 3D central difference convolutional dense network for hyperspectral image classification

Multibranch 3D-Dense Attention Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on 3-D Octave Convolution With Spatial–Spectral Attention Network

MS3Net: Multiscale Stratified-Split Symmetric Network with Quadra-View Attention for Hyperspectral Image Classification

An attention-driven convolutional neural network-based multi-level spectral–spatial feature learning for hyperspectral image classification

Attention-Aware Pseudo-3-D Convolutional Neural Network for Hyperspectral Image Classification

Semisupervised Hyperspectral Image Classification Network Based on Pseudo-Label and Spatial–Spectral Convolution

An Investigation of a Multidimensional CNN Combined with an Attention Mechanism Model to Resolve Small-Sample Problems in Hyperspectral Image Classification

End-to-End Multilevel Hybrid Attention Framework for Hyperspectral Image Classification.

Hyperspectral Image Classification Using Spectral–Spatial Double-Branch Attention Mechanism