Abstract:In recent years, deep learning-based methods have exhibited remarkable performance in the field of hyperspectral image (HSI) classification. However, conventional supervised methods heavily rely on a substantial number of labeled samples. Self-supervised learning, as a prominent unsupervised representation learning technique, offers the potential to extract valuable information from unlabeled data. In this article, we introduce a novel unsupervised approach called self-supervised learning with the multiscale densely connected network (SS-MSDCNet) to make full use of unlabeled samples for HSI classification. First, a two-stream structure was designed to generate more positive pairs, which enables the contrast self-supervised training to learn more useful information from unlabeled data. Subsequently, a data augmentation technique based on spectral splitting was proposed to coordinate the two-stream structure of SS-MSDCNet, enhancing spectral information expression. The backbone of the proposed approach is the multiscale densely connected network (MSDCNet), which obtains input HSIs with various spatial scales by removing peripheral pixels from the original input and subsequently extracts multiscale spatial-spectral features using 3-D densely connected modules and 3-D spatial attention modules. The 3-D densely connected module effectively harnesses multiscale features extracted by various convolutional layers, while the 3-D spatial attention module enhances the network's focus on features conducive to accurate classification. To validate the efficacy of our approach, we conducted extensive experiments using four distinct HSI datasets. The results unequivocally demonstrate that SS-MSDCNet outperforms several well-established supervised and unsupervised classification methods. Furthermore, we designed a transfer experiment to confirm SS-MSDCNet's robust generalization capabilities. The code is available at https://github.com/mrblank99/SS-MSDCNet.

Supervised Learning with Convolutional Neural Networks for Hyperspectral Visualization

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

Constrained Manifold Learning for Hyperspectral Imagery Visualization

Visualization of Hyperspectral Images Using Moving Least Squares

A Manifold Alignment Approach for Hyperspectral Image Visualization with Natural Color.

Deep Convolutional Networks with Superpixel Segmentation for Hyperspectral Image Classification

An Unsupervised Band Selection Method Based on Triple Constraints and Attention Network for Hyperspectral Imagery

Visualization of Hyperspectral Imaging Data Based on Manifold Alignment

Hierarchical Superpixel Relation Graph Combined with Convolutional Sparse Coding for Self-Supervised Hyperspectral Image Denoising

Spatial Proximity Feature Selection With Residual Spatial-Spectral Attention Network for Hyperspectral Image Classification.

Integrating Convolutional Neural Network and Gated Recurrent Unit for Hyperspectral Image Spectral-Spatial Classification.

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

Hierarchical Multi-Scale Convolutional Neural Networks For Hyperspectral Image Classification

Learning a 3D-CNN and Convolution Transformers for Hyperspectral Image Classification

Self-Supervised Learning With Multiscale Densely Connected Network for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

Semi-Supervised Multiscale Dynamic Graph Convolution Network for Hyperspectral Image Classification

Hyperspectral Image Super-resolution via Deep Spatio-spectral Convolutional Neural Networks

Joint spectral-spatial hyperspectral classification based on transfer learning (SSTL) from red-green-blue (RGB) images

Hyper-LGNet: Coupling Local and Global Features for Hyperspectral Image Classification

End-to-End Convolutional Network and Spectral-Spatial Transformer Architecture for Hyperspectral Image Classification