Abstract:Deep learning has achieved promising results for hyperspectral image (HSI) classification in recent years due to its hierarchical structure and automatic feature extraction ability from raw data. The HSI has continuous spectral information, allowing for the precise identification of materials by capturing minute spectral differences. Convolutional neural networks (CNNs) have proven to be effective feature extractors for HSI classification. However, inherent network limitations prevent them from adequately mining and representing the sequence attributes of spectral signatures and learning critical and valuable features from both spectral and spatial dimensions simultaneously. This paper proposes a deep learning-based framework called a novel dual attention-based multiscale-multilevel ConvLSTM3D (DAMCL) to address these challenges. In this work, our contribution is threefold; firstly, a dual attention mechanism is proposed, effectively learning critical and valuable features from spectral and spatial dimensions. Secondly, multiscale ConvLSTM3D blocks can learn the discriminative features alongside handling long-range dependencies of spectral data. Thirdly, these features are combined by a multilevel feature fusion approach to maximize the impact of features learned at different levels. To assess the performance of the proposed method, extensive experiments are carried out on five different benchmark datasets containing complex and challenging land cover classes. The results confirm that the proposed method outperforms state-of-the-art techniques with a small number of training samples in terms of overall accuracy (OA), average accuracy (AA), and Kappa ( k ) . The overall accuracy of 98.88%, 99.42%, 99.20%, 95.37%, and 92.57% is achieved over the Indian Pines, Salinas Valley, University of Pavia, Houston 2013, and Houston 2018 datasets, respectively.

Spectral Feature Fusion Networks with Dual Attention for Hyperspectral Image Classification

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Feature Fusion Network Model Based on Dual Attention Mechanism for Hyperspectral Image Classification

Spectral-Spatial Fused Attention Network for Hyperspectral Image Classification

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Hyperspectral Image Classification Based on Dual-Channel Network with Spectral-Spatial Fusion Attention

Deep Feature Fusion via Two-Stream Convolutional Neural Network for Hyperspectral Image Classification

DSSFN: A Dual-Stream Self-Attention Fusion Network for Effective Hyperspectral Image Classification

Dual-View Spectral and Global Spatial Feature Fusion Network for Hyperspectral Image Classification

An Attention-Enhanced Feature Fusion Network (AeF<SUP>2</SUP>N) for Hyperspectral Image Classification

Asymmetric Coordinate Attention Spectral-Spatial Feature Fusion Network for Hyperspectral Image Classification

Dual-Layer Multi-Level Architecture and Spatial-Spectral Semantic Feature Fusion for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Dual-Scale Dense Network with Efficient Channel Attentional Feature Fusion

Hyperspectral Classification via Global-Local Hierarchical Weighting Fusion Network

Deep Spectral-Spatial Feature Fusion-Based Multiscale Adaptable Attention Network for Hyperspectral Feature Extraction

Fusing Spatial Attention with Spectral-Channel Attention Mechanism for Hyperspectral Image Classification via Encoder-Decoder Networks

Hyperspectral Image Classification Based on Double-hop Graph Attention Multi-view Fusion Network

Spectral-Spatial Classification Of Hyperspectral Image Based On A Joint Attention Network

Feature Fusion: Graph Attention Network and CNN Combing for Hyperspectral Image Classification

A Dual Attention Driven Multiscale-Multilevel Feature Fusion Approach for Hyperspectral Image Classification