Abstract:In recent years, methods based on deep convolutional neural networks (CNNs) have dominated the classification task of hyperspectral images. Although CNN-based HSI classification methods have the advantages of spatial feature extraction, HSI images are characterized by approximately continuous spectral information, usually containing hundreds of spectral bands. CNN cannot mine and represent the sequence properties of spectral features well, and the transformer model of attention mechanism proves its advantages in processing sequence data. This study proposes a new spectral spatial kernel combined with the improved Vision Transformer (ViT) to jointly extract spatial spectral features to complete classification task. First, the hyperspectral data are dimensionally reduced by PCA; then, the shallow features are extracted with an spectral spatial kernel, and the extracted features are input into the improved ViT model. The improved ViT introduces a re-attention mechanism and a local mechanism based on the original ViT. The re-attention mechanism can increase the diversity of attention maps at different levels. The local mechanism is introduced into ViT to make full use of the local and global information of the data to improve the classification accuracy. Finally, a multi-layer perceptron is used to obtain the classification result. Among them, the Focal Loss function is used to increase the loss weight of small-class samples and difficult-to-classify samples in HSI data samples and reduce the loss weight of easy-to-classify samples, so that the network can learn more useful hyperspectral image information. In addition, using the Apollo optimizer to train the HSI classification model to better update and compute network parameters that affect model training and model output, thereby minimizing the loss function. We evaluated the classification performance of the proposed method on four different datasets, and achieved good classification results on urban land object classification, crop classification and mineral classification, respectively. Compared with the state-of-the-art backbone network, the method achieves a significant improvement and achieves very good classification accuracy.

Hyperspectral image classification based on local feature decoupling and hybrid attention SpectralFormer network

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Hybrid 2D–3D convolution and pre-activated residual networks for hyperspectral image classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

HAMNet: hyperspectral image classification based on hybrid neural network with attention mechanism and multi-scale feature fusion

Hyperspectral Image Classification Based on Multibranch Attention Transformer Networks

Multi-Scale Residual Spectral–Spatial Attention Combined with Improved Transformer for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Two-Branch Spectral–Spatial-Feature Attention Network

Hyperspectral Image Classification Based on 3-D Octave Convolution With Spatial–Spectral Attention Network

A hyperspectral image classification method based on feature enhancement and a hybrid deformable convolution network

Hyperspectral Image Classification via Deep Network with Attention Mechanism and Multigroup Strategy

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

A Hyperspectral Image Classification Method Based on Adaptive Spectral Spatial Kernel Combined with Improved Vision Transformer

MHIAIFormer: Multihead Interacted and Adaptive Integrated Transformer With Spatial-Spectral Attention for Hyperspectral Image Classification

MHIAIFormer: Multi-Head Interacted and Adaptive Integrated Transformer with Spatial-Spectral Attention for Hyperspectral Image Classification

Hierarchical Attention and Parallel Filter Fusion Network for Multisource Data Classification

Hyperspectral Image Classification via Spectral Pooling and Hybrid Transformer

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Hyperspectral image classification based on channel perception mechanism and hybrid deformable convolution network

Hyperspectral image classification based on spectral and spatial information using ResNet with channel attention