Abstract:Deep learning (DL) has become a mainstream method of hyperspectral image (HSI) classification. Many DL-based methods exploit spatial-spectral features to achieve better classification results. However, due to the complex backgrounds in HSIs, existing methods usually show unsatisfactory performance for the class pixels located on the land-cover category boundary area. In large part, this is because the network is susceptible to interference by the irrelevant information around the target pixel in the training stage, resulting in inaccurate feature extraction. In this article, a new multibranch transformer architecture (spectral spatial transformer (SST)-M) that assembles spatial attention and extracts spectral features is proposed to address this problem. The transformer model has a global receptive field and thus can integrate global spatial position information in the HSI cube. Meanwhile, we design a spatial sequence attention model to enhance the useful spatial location features and weaken invalid information. Considering that HSIs contain considerable spectral information, a spectral feature extraction model is designed to extract discriminative spectral features, replacing the widely used principal component analysis (PCA) method and obtaining better classification results than it. Finally, inspired by semantic segmentation, a mask prediction model is designed to classify all of the pixels in the HSI cube; this guides the neural network to learn precise pixel characteristics and spatial distributions. To verify the effectiveness of our algorithm (SST-M), quantitative experiments were conducted in three well-known datasets, namely, Indian Pines (IP), University of Pavia (PU), and Kennedy Space Center (KSC). The experimental results demonstrate that the proposed model achieves better performance than the other state-of-the-art methods.

Double-Branch Network with Pyramidal Convolution and Iterative Attention for Hyperspectral Image Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Hyperspectral Image Classification Using Spectral–Spatial Double-Branch Attention Mechanism

<i>H<SUP>2</SUP>A<SUP>2</SUP></i>Net: A Hybrid Convolution and Hybrid Resolution Network with Double Attention for Hyperspectral Image Classification

Two-Branch Convolutional Neural Network with Polarized Full Attention for Hyperspectral Image Classification

Dual-Branch Attention-Assisted CNN for Hyperspectral Image Classification

A Triple-Path Spectral–Spatial Network With Interleave-Attention for Hyperspectral Image Classification

Hyperspectral image classification using a double-branch hierarchical partial convolution network

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Classfication of Hyperspectral Image with Attention Mechanism-Based Dual-Path Convolutional Network

Hyperspectral Image Classification Based on Two-Branch Spectral–Spatial-Feature Attention Network

Hyperspectral image classification based on hybrid convolutional neural network with triplet attention

Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network

DCTN: Dual-Branch Convolutional Transformer Network With Efficient Interactive Self-Attention for Hyperspectral Image Classification

Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search

Hyperspectral Image Classification Based on Multibranch Attention Transformer Networks

Pyramidal and conditional convolution attention network for hyperspectral image classification using limited training samples

Hyperspectral Image Classification Based on a 3D Octave Convolution and 3D Multiscale Spatial Attention Network

Dual-Branch Spectral–Spatial Attention Network for Hyperspectral Image Classification

Compound Multiscale Weak Dense Network with Hybrid Attention for Hyperspectral Image Classification