Abstract:Deep learning (DL) has become a mainstream method of hyperspectral image (HSI) classification. Many DL-based methods exploit spatial-spectral features to achieve better classification results. However, due to the complex backgrounds in HSIs, existing methods usually show unsatisfactory performance for the class pixels located on the land-cover category boundary area. In large part, this is because the network is susceptible to interference by the irrelevant information around the target pixel in the training stage, resulting in inaccurate feature extraction. In this article, a new multibranch transformer architecture (spectral spatial transformer (SST)-M) that assembles spatial attention and extracts spectral features is proposed to address this problem. The transformer model has a global receptive field and thus can integrate global spatial position information in the HSI cube. Meanwhile, we design a spatial sequence attention model to enhance the useful spatial location features and weaken invalid information. Considering that HSIs contain considerable spectral information, a spectral feature extraction model is designed to extract discriminative spectral features, replacing the widely used principal component analysis (PCA) method and obtaining better classification results than it. Finally, inspired by semantic segmentation, a mask prediction model is designed to classify all of the pixels in the HSI cube; this guides the neural network to learn precise pixel characteristics and spatial distributions. To verify the effectiveness of our algorithm (SST-M), quantitative experiments were conducted in three well-known datasets, namely, Indian Pines (IP), University of Pavia (PU), and Kennedy Space Center (KSC). The experimental results demonstrate that the proposed model achieves better performance than the other state-of-the-art methods.

Hyperspectral image classification using a double-branch hierarchical partial convolution network

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

A Dual-Branch Network Based on Transformer and Depthwise Convolution for Hyperspectral Image Classification

Hyperspectral Image Classification Using Hierarchical Spatial-Spectral Transformer

Double-Branch Network with Pyramidal Convolution and Iterative Attention for Hyperspectral Image Classification

DBCTNet: Double Branch Convolution-Transformer Network for Hyperspectral Image Classification

CNN and Transformer Hybrid Network for Hyperspectral Image Classification

A Dual-Branch Multiscale Transformer Network for Hyperspectral Image Classification

Dual-Branch Adaptive Convolutional Transformer for Hyperspectral Image Classification

DCTN: Dual-Branch Convolutional Transformer Network With Efficient Interactive Self-Attention for Hyperspectral Image Classification

Dual-Branch Spectral–Spatial Attention Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Multi-Level Spectral-Spatial Transformer Network

Double-branch feature fusion transformer for hyperspectral image classification

A Locally Enhanced Transformer Network for Hyperspectral Image Classification

Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

Hyperspectral Image Classification Using Spectral–Spatial Double-Branch Attention Mechanism

Hyperspectral Image Classification Method Based on 2d–3d CNN and Multibranch Feature Fusion

Automatic Clustering-Based Two-Branch CNN for Hyperspectral Image Classification

A Hybrid Neural Network for Hyperspectral Image Classification

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Hyperspectral Image Classification Based on Multibranch Attention Transformer Networks