Abstract:With the continuous innovation in deep learning, it has become a major direction for scholars to introduce the knowledge of deep learning into hyperspectral image classification to enhance its classification accuracy. Convolutional Neural Networks (CNN) are one of the most commonly used deep learning-based visual data processing methods, and are widely used in hyperspectral image (HSI) classification by virtue of their excellent contextual modeling capability. Since the performance of HSI classification is highly dependent on spatial and spectral information, this paper proposes a hyperspectral image classification method using 3D attention mechanism in collaboration with Transformer for hyperspectral image classification in view of the problems that the current hyperspectral image classification models with the framework of CNN have insufficient spatial spectral feature extraction and fail to excavate and represent the sequence properties of spectral features well. In this paper, we introduce a variant Transformer model based on a hybrid model of both improved 3D-CNN and 2D-CNN, combining complementary information of spatial spectrum and spectra in the form of 3D convolution and 2D convolution on CNN, and adding a variant attention mechanism module to strengthen spatial texture features, while combining grouped transfer Transformer to jump connection to enable the lower layer to better learn the upper layer features. Firstly, a variant channel attention mechanism is introduced on 3D-CNN to enhance the acquisition of spectral information of image features by 3D-CNN. Secondly, a variant spatial attention mechanism is introduced to enable 3D-CNN to better acquire the spatial information of hyperspectral images in the network, and subsequently the acquired spatial and spectral feature information is passed to 2D-CNN to enable it to better acquire local feature information. Finally, the acquired image feature information is passed to the variant Transformer model to make up for the fact that CNN can only acquire hyperspectral image features in local contexts, enabling it to better acquire global feature information on feature sequences. The experimental results show that the proposed model is experimented on two hyperspectral datasets, Indian Pines and Pavia University, and the overall classification accuracy (OA), average classification accuracy (AA), and Kappa coefficient reach up to 99.59%, 99.31%, and 99.45%, respectively, on the PU dataset, compared with the current cutting-edge techniques. The classification accuracy has been improved.

3D‐TabNetHS: A hyperspectral image classification method based on improved interpretable 3D attentive TabNet

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Enhanced TabNet: Attentive Interpretable Tabular Learning for Hyperspectral Image Classification

Hyperspectral Image Classification Based on 3-D Octave Convolution With Spatial–Spectral Attention Network

Three-dimensional Densely Connected Convolutional Network for Hyperspectral Remote Sensing Image Classification

Hyperspectral Image Classification Based on 3D Coordination Attention Mechanism Network

Hybrid 2D–3D convolution and pre-activated residual networks for hyperspectral image classification

Learnable three-dimensional Gabor convolutional network with global affinity attention for hyperspectral image classification

A 3D Cascaded Spectral–Spatial Element Attention Network for Hyperspectral Image Classification

Spectral-Spatial-Sensorial Attention Network with Controllable Factors for Hyperspectral Image Classification

Spatial-Spectral Network for Hyperspectral Image Classification: A 3-D CNN and Bi-LSTM Framework

An Unsupervised Band Selection Method Based on Triple Constraints and Attention Network for Hyperspectral Imagery

Heterogeneous Spectral-Spatial Network with 3D Attention and MLP for Hyperspectral Image Classification Using Limited Training Samples

Attention 3D central difference convolutional dense network for hyperspectral image classification

Incorporating Attention Mechanism and Graph Regularization into Cnns for Hyperspectral Image Classification

Attention-Aware Pseudo-3-D Convolutional Neural Network for Hyperspectral Image Classification

Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network

A hybrid approach consisting of 3D depthwise separable convolution and depthwise squeeze-and-excitation network for hyperspectral image classification

Hyperspectral Image Classification Using 3D Attention Mechanism in Collaboration with Transformer

Spatial–Spectral Split Attention Residual Network for Hyperspectral Image Classification

Center-similarity spectral-spatial attention network for hyperspectral image classification