Abstract:Convolutional neural networks (CNNs) have shown impressive results in the hyperspectral image (HSI) classification. However, they still face certain limitations that can impact their effectiveness. The kernels in standard convolution have fixed spatial sizes and spectral depths, which cannot capture global semantic features from HSI and the existing methods for extracting multiscale information are inadequate. Based on these, we propose a global and pyramid convolutional network with a hybrid attention mechanism (GPHANet) for HSI classification. GPHANet adopts a two-branch architecture to extract both local and global hyperspectral features, leveraging the strengths of each to enhance classification performance. The local branch employs dynamic pyramid convolution, which customizes parameters for convolutional kernels of multiple scales based on the input image. This design enables the model to accurately and comprehensively extract multiscale feature information, capturing subtle variations in the HSI. The global branch utilizes circular convolution with a global receptive field, enabling each position in the convolutional layers to gather information from the entire input space. This allows the model to learn global contextual features, enhancing its understanding of the overall structure and semantics of the HSI. After extracting deep global and local features, we apply a compact hybrid attention mechanism (HAM) to capture long-range dependencies along both spatial and spectral dimensions, resulting in a more discriminative feature representation. On the Pavia University, Salinas, and Hong Hu datasets, the proposed model achieved overall accuracies of 99.22%, 98.74%, and 96.80%, respectively, using limited training samples. These results are much better compared to the state-of-the-art methods.

Classfication of Hyperspectral Image with Attention Mechanism-Based Dual-Path Convolutional Network

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Attention Multihop Graph and Multiscale Convolutional Fusion Network for Hyperspectral Image Classification

Attention-based Multi-Scale Network for Hyperspectral Image Classification

HDECGCN: A Heterogeneous Dual Enhanced Network Based on Hybrid CNNs Joint Multiscale Dynamic GCNs for Hyperspectral Image Classification

Double-Branch Network with Pyramidal Convolution and Iterative Attention for Hyperspectral Image Classification

Hyperspectral Image Classification Framework Based on Multichannel Graph Convolutional Networks and Class-Guided Attention Mechanism

Attention Graph Convolutional Network for Disjoint Hyperspectral Image Classification

Cnn-assisted multi-hop graph attention network for hyperspectral image classification

Global and pyramid convolutional neural network with hybrid attention mechanism for hyperspectral image classification

Hyperspectral image classification based on hybrid convolutional neural network with triplet attention

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

A Dual-Branch Fusion of a Graph Convolutional Network and a Convolutional Neural Network for Hyperspectral Image Classification

Hyperspectral Image Classification with a Multiscale Fusion-Evolution Graph Convolutional Network Based on a Feature-Spatial Attention Mechanism

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Hypergraph Convolutional Network With Multiple Hyperedges Fusion for Hyperspectral Image Classification Under Limited Samples

Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search

Dual-Branch Attention-Assisted CNN for Hyperspectral Image Classification

Dual-Channel Convolution Network With Image-Based Global Learning Framework for Hyperspectral Image Classification

Attention Mechanism Meets with Hybrid Dense Network for Hyperspectral Image Classification