Abstract:In recent years, deep learning-based methods have exhibited remarkable performance in the field of hyperspectral image (HSI) classification. However, conventional supervised methods heavily rely on a substantial number of labeled samples. Self-supervised learning, as a prominent unsupervised representation learning technique, offers the potential to extract valuable information from unlabeled data. In this article, we introduce a novel unsupervised approach called self-supervised learning with the multiscale densely connected network (SS-MSDCNet) to make full use of unlabeled samples for HSI classification. First, a two-stream structure was designed to generate more positive pairs, which enables the contrast self-supervised training to learn more useful information from unlabeled data. Subsequently, a data augmentation technique based on spectral splitting was proposed to coordinate the two-stream structure of SS-MSDCNet, enhancing spectral information expression. The backbone of the proposed approach is the multiscale densely connected network (MSDCNet), which obtains input HSIs with various spatial scales by removing peripheral pixels from the original input and subsequently extracts multiscale spatial-spectral features using 3-D densely connected modules and 3-D spatial attention modules. The 3-D densely connected module effectively harnesses multiscale features extracted by various convolutional layers, while the 3-D spatial attention module enhances the network's focus on features conducive to accurate classification. To validate the efficacy of our approach, we conducted extensive experiments using four distinct HSI datasets. The results unequivocally demonstrate that SS-MSDCNet outperforms several well-established supervised and unsupervised classification methods. Furthermore, we designed a transfer experiment to confirm SS-MSDCNet's robust generalization capabilities. The code is available at https://github.com/mrblank99/SS-MSDCNet.

An Experimental Comparison of Semi-supervised Learning Algorithms for Multispectral Image Classification

Image colourisation using graph-based semi-supervised learning

Image classification of hyperspectral remote sensing using semi-supervised learning algorithm

Self-Supervised Learning With Prediction of Image Scale and Spectral Order for Hyperspectral Image Classification

Self-Supervised Learning in Remote Sensing: A review

A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery

Label Diagnosis Through Self Tuning for Web Image Search

Scalable Semi-Supervised Classification Of Hyperspectral Remote Sensing Data With Spectral And Spatial Information

Semi-supervised spectral-spatial weighted classification of hyperspectral image based on SVMSLR framework

Land Cover and Land Use Detection using Semi-Supervised Learning

Supervised Classification Performance of Multispectral Images

On Improving the Algorithm-, Model-, and Data- Efficiency of Self-Supervised Learning

Semi-Supervised Hyperspectral Image Classification Based on Multiscale Spectral–Spatial Graph Attention Network

Multi-class SVM based remote sensing image classification and its semi-supervised improvement scheme

Spectral–Spatial Hyperspectral Image Classification Based on Multiple Views and Multigraphs Fusion with Few Labeled Samples

OCI-SSL: Open Class-Imbalanced Semi-Supervised Learning with Contrastive Learning

Hyperspectral Image Classification With Contrastive Self-Supervised Learning Under Limited Labeled Samples

On the Discriminability of Self-Supervised Representation Learning

A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

Robust Semi-Supervised Learning when Not All Classes have Labels

Self-Supervised Learning With Multiscale Densely Connected Network for Hyperspectral Image Classification