Abstract:Deep learning has achieved promising results for hyperspectral image (HSI) classification in recent years due to its hierarchical structure and automatic feature extraction ability from raw data. The HSI has continuous spectral information, allowing for the precise identification of materials by capturing minute spectral differences. Convolutional neural networks (CNNs) have proven to be effective feature extractors for HSI classification. However, inherent network limitations prevent them from adequately mining and representing the sequence attributes of spectral signatures and learning critical and valuable features from both spectral and spatial dimensions simultaneously. This paper proposes a deep learning-based framework called a novel dual attention-based multiscale-multilevel ConvLSTM3D (DAMCL) to address these challenges. In this work, our contribution is threefold; firstly, a dual attention mechanism is proposed, effectively learning critical and valuable features from spectral and spatial dimensions. Secondly, multiscale ConvLSTM3D blocks can learn the discriminative features alongside handling long-range dependencies of spectral data. Thirdly, these features are combined by a multilevel feature fusion approach to maximize the impact of features learned at different levels. To assess the performance of the proposed method, extensive experiments are carried out on five different benchmark datasets containing complex and challenging land cover classes. The results confirm that the proposed method outperforms state-of-the-art techniques with a small number of training samples in terms of overall accuracy (OA), average accuracy (AA), and Kappa ( k ) . The overall accuracy of 98.88%, 99.42%, 99.20%, 95.37%, and 92.57% is achieved over the Indian Pines, Salinas Valley, University of Pavia, Houston 2013, and Houston 2018 datasets, respectively.

Dual-Layer Multi-Level Architecture and Spatial-Spectral Semantic Feature Fusion for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Dual-Channel Network with Spectral-Spatial Fusion Attention

A Novel 2D-3D CNN with Spectral-Spatial Multi-Scale Feature Fusion for Hyperspectral Image Classification

Hyperspectral Image Classification Method Based on 2d–3d CNN and Multibranch Feature Fusion

Hyperspectral Image Classification Method Based on 2D–3D CNN and Multibranch Feature Fusion

Deep CNN-based Hyperspectral Image Classification Using Discriminative Multiple Spatial-Spectral Feature Fusion

Hyperspectral Image Classification Using CNN-Enhanced Multi-Level Haar Wavelet Features Fusion Network

Subpixel Multilevel Scale Feature Learning and Adaptive Attention Constraint Fusion for Hyperspectral Image Classification

Multi-layer feature fusion for hyperspectral image classification

A Dual Attention Driven Multiscale-Multilevel Feature Fusion Approach for Hyperspectral Image Classification

Dual-View Spectral and Global Spatial Feature Fusion Network for Hyperspectral Image Classification

The real-time and stack fusion enhanced dual-channel network with attention modules for fast hyperspectral image classification

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

A Multi-branch Feature Fusion Model Based on Convolutional Neural Network for Hyperspectral Remote Sensing Image Classification

Fully Dense Multiscale Fusion Network for Hyperspectral Image Classification

Compound Multiscale Weak Dense Network with Hybrid Attention for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Multilevel Joint Feature Extraction Network

A Hybrid 3D–2D Feature Hierarchy CNN with Focal Loss for Hyperspectral Image Classification

Multiscale Spatial-Spectral Convolutional Network with Image-Based Framework for Hyperspectral Imagery Classification.

Hyperspectral Image Classification Based on Dual-Scale Dense Network with Efficient Channel Attentional Feature Fusion

An attention-driven convolutional neural network-based multi-level spectral–spatial feature learning for hyperspectral image classification