Abstract:In recent years, deep learning-based methods have exhibited remarkable performance in the field of hyperspectral image (HSI) classification. However, conventional supervised methods heavily rely on a substantial number of labeled samples. Self-supervised learning, as a prominent unsupervised representation learning technique, offers the potential to extract valuable information from unlabeled data. In this article, we introduce a novel unsupervised approach called self-supervised learning with the multiscale densely connected network (SS-MSDCNet) to make full use of unlabeled samples for HSI classification. First, a two-stream structure was designed to generate more positive pairs, which enables the contrast self-supervised training to learn more useful information from unlabeled data. Subsequently, a data augmentation technique based on spectral splitting was proposed to coordinate the two-stream structure of SS-MSDCNet, enhancing spectral information expression. The backbone of the proposed approach is the multiscale densely connected network (MSDCNet), which obtains input HSIs with various spatial scales by removing peripheral pixels from the original input and subsequently extracts multiscale spatial-spectral features using 3-D densely connected modules and 3-D spatial attention modules. The 3-D densely connected module effectively harnesses multiscale features extracted by various convolutional layers, while the 3-D spatial attention module enhances the network's focus on features conducive to accurate classification. To validate the efficacy of our approach, we conducted extensive experiments using four distinct HSI datasets. The results unequivocally demonstrate that SS-MSDCNet outperforms several well-established supervised and unsupervised classification methods. Furthermore, we designed a transfer experiment to confirm SS-MSDCNet's robust generalization capabilities. The code is available at https://github.com/mrblank99/SS-MSDCNet.

Semi-Supervised Learning Via Convolutional Neural Network For Hyperspectral Image Classification

Semi-Active Convolutional Neural Networks for Hyperspectral Image Classification

Self-Supervised Convolutional Neural Network Via Spectral Attention Module for Hyperspectral Image Classification

Collaborative learning of lightweight convolutional neural network and deep clustering for hyperspectral image semi-supervised classification with limited training samples

Hyperspectral Image Classification Based on Spectral Graph and Bidirectional LSTM Network.

Semisupervised deep learning using consistency regularization and pseudolabels for hyperspectral image classification

Semi-supervised Deep Learning for Hyperspectral Image Classification

Self-Supervised Learning With Multiscale Densely Connected Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Semi-Supervised Dual-Branch Convolutional Autoencoder with Self-Attention.

Semi-Supervised Deep Learning Classification for Hyperspectral Image Based on Dual-Strategy Sample Selection

ClusterCNN: Clustering-Based Feature Learning for Hyperspectral Image Classification

Multiscale CNNs Ensemble Based Self-Learning for Hyperspectral Image Classification

Semi-Supervised Feature Learning For Hyperspectral Image Classification

Semisupervised Classification of Hyperspectral Image Based on Graph Convolutional Broad Network

Semisupervised Hyperspectral Image Classification Network Based on Pseudo-Label and Spatial–Spectral Convolution

Semi-Supervised Hyperspectral Image Classification via Spatial-Regulated Self-Training

Semisupervised Hyperspectral Image Classification Via Discriminant Analysis and Robust Regression.

Supervised Classification of Hyperspectral Images Via Heterogeneous Deep Neural Networks

Semi-Supervised Multiscale Dynamic Graph Convolution Network for Hyperspectral Image Classification

Semisupervised Classification Based on SLIC Segmentation for Hyperspectral Image

Deep CNN-based Hyperspectral Image Classification Using Discriminative Multiple Spatial-Spectral Feature Fusion