Abstract:In recent years, deep learning-based methods have exhibited remarkable performance in the field of hyperspectral image (HSI) classification. However, conventional supervised methods heavily rely on a substantial number of labeled samples. Self-supervised learning, as a prominent unsupervised representation learning technique, offers the potential to extract valuable information from unlabeled data. In this article, we introduce a novel unsupervised approach called self-supervised learning with the multiscale densely connected network (SS-MSDCNet) to make full use of unlabeled samples for HSI classification. First, a two-stream structure was designed to generate more positive pairs, which enables the contrast self-supervised training to learn more useful information from unlabeled data. Subsequently, a data augmentation technique based on spectral splitting was proposed to coordinate the two-stream structure of SS-MSDCNet, enhancing spectral information expression. The backbone of the proposed approach is the multiscale densely connected network (MSDCNet), which obtains input HSIs with various spatial scales by removing peripheral pixels from the original input and subsequently extracts multiscale spatial-spectral features using 3-D densely connected modules and 3-D spatial attention modules. The 3-D densely connected module effectively harnesses multiscale features extracted by various convolutional layers, while the 3-D spatial attention module enhances the network's focus on features conducive to accurate classification. To validate the efficacy of our approach, we conducted extensive experiments using four distinct HSI datasets. The results unequivocally demonstrate that SS-MSDCNet outperforms several well-established supervised and unsupervised classification methods. Furthermore, we designed a transfer experiment to confirm SS-MSDCNet's robust generalization capabilities. The code is available at https://github.com/mrblank99/SS-MSDCNet.

S2HM2: A Spectral–Spatial Hierarchical Masked Modeling Framework for Self-Supervised Feature Learning and Classification of Large-Scale Hyperspectral Images

HSIMAE: A Unified Masked Autoencoder with Large-scale Pre-training for Hyperspectral Image Classification

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

Self-Supervised Feature Learning Based on Spectral Masking for Hyperspectral Image Classification

Self-Supervised Learning With Prediction of Image Scale and Spectral Order for Hyperspectral Image Classification

MSMT-LCL: Multiscale Spatial-Spectral Masked Transformer With Local Contrastive Learning for Hyperspectral Image Classification

LFSMIM: A Low-Frequency Spectral Masked Image Modeling Method for Hyperspectral Image Classification

Generative Self-Supervised Learning With Spectral-Spatial Masking for Hyperspectral Target Detection

Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstruction

Mask-Enhanced Contrastive Learning for Hyperspectral Image Classification

Self-Supervised Learning With Multiscale Densely Connected Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Multiscale Spatial and Spectral Feature Network.

S2DMSC: A Self-Supervised Deep Multilevel Subspace Clustering Approach for Large Hyperspectral Images

Adaptive Mask Sampling and Manifold to Euclidean Subspace Learning with Distance Covariance Representation for Hyperspectral Image Classification.

Superpixel-based multi-scale multi-instance learning for hyperspectral image classification

Nearest Neighboring Self-Supervised Learning for Hyperspectral Image Classification

Instructional Mask Autoencoder: A Scalable Learner for Hyperspectral Image Classification

SS-MAE: SpatialCSpectral Masked Autoencoder for Multisource Remote Sensing Image Classification

A Spectral-Spatial SVM-based Multi-Layer Learning Algorithm for Hyperspectral Image Classification

Multimorphological Superpixel Model for Hyperspectral Image Classification

M^2 S^2 F^2 : Multiscale Multistage Spectral-Spatial Features Fusion Framework for Hyperspectral Image Classification