Abstract:In recent years, deep learning-based methods have exhibited remarkable performance in the field of hyperspectral image (HSI) classification. However, conventional supervised methods heavily rely on a substantial number of labeled samples. Self-supervised learning, as a prominent unsupervised representation learning technique, offers the potential to extract valuable information from unlabeled data. In this article, we introduce a novel unsupervised approach called self-supervised learning with the multiscale densely connected network (SS-MSDCNet) to make full use of unlabeled samples for HSI classification. First, a two-stream structure was designed to generate more positive pairs, which enables the contrast self-supervised training to learn more useful information from unlabeled data. Subsequently, a data augmentation technique based on spectral splitting was proposed to coordinate the two-stream structure of SS-MSDCNet, enhancing spectral information expression. The backbone of the proposed approach is the multiscale densely connected network (MSDCNet), which obtains input HSIs with various spatial scales by removing peripheral pixels from the original input and subsequently extracts multiscale spatial-spectral features using 3-D densely connected modules and 3-D spatial attention modules. The 3-D densely connected module effectively harnesses multiscale features extracted by various convolutional layers, while the 3-D spatial attention module enhances the network's focus on features conducive to accurate classification. To validate the efficacy of our approach, we conducted extensive experiments using four distinct HSI datasets. The results unequivocally demonstrate that SS-MSDCNet outperforms several well-established supervised and unsupervised classification methods. Furthermore, we designed a transfer experiment to confirm SS-MSDCNet's robust generalization capabilities. The code is available at https://github.com/mrblank99/SS-MSDCNet.

Dual-input ultralight multi-head self-attention learning network for hyperspectral image classification

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

A Dual Multi-Head Contextual Attention Network for Hyperspectral Image Classification

Ultralightweight Feature-Compressed Multihead Self-Attention Learning Networks for Hyperspectral Image Classification

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

Double Attention based Multi-level One-Dimensional Convolution Neural Network for Hyperspectral Image Classification

Dual-Branch Attention-Assisted CNN for Hyperspectral Image Classification

One-Shot Dense Network with Polarized Attention for Hyperspectral Image Classification

A Multiscale Dual-Branch Feature Fusion and Attention Network for Hyperspectral Images Classification

Hyperspectral Image Classification Based on Multibranch Attention Transformer Networks

Hybrid Dense Network with Dual Attention for Hyperspectral Image Classification

Pseudo Complex-Valued Deformable ConvLSTM Neural Network With Mutual Attention Learning for Hyperspectral Image Classification

Hyperspectral Image Classification Using Attention-Based Bidirectional Long Short-Term Memory Network

Multiscale Feature Fusion Network Incorporating 3D Self-Attention for Hyperspectral Image Classification

Self-Supervised Learning With Multiscale Densely Connected Network for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

A Cross-Channel Dense Connection and Multi-Scale Dual Aggregated Attention Network for Hyperspectral Image Classification

Differential Self-Feedback Dilated Convolution Network With Dual-Tree Channel Attention Mechanism for Hyperspectral Image Classification

Heterogeneous Spectral-Spatial Network with 3D Attention and MLP for Hyperspectral Image Classification Using Limited Training Samples

Hyperspectral Image Classification via Deep Network with Attention Mechanism and Multigroup Strategy

A Hybrid Multitask Learning Network for Hyperspectral Image Classification With Few Labels