Abstract:In recent years, deep-learning-based hyperspectral image (HSI) classification methods have achieved significant development. The superior capability of feature extraction from these data-driven methods dramatically improves classification performance. However, the previous methods usually require retraining the network from scratch to obtain the capability of feature extraction adaptive for the target image when facing a new HSI to be classified, which is a time-consuming and redundant process. In this article, we consider putting this process ahead and making the network have a robust capability of feature extraction with generalization through pretraining. Therefore, the network enables to directly extract features of the target HSI without retraining. For this purpose, we rethink the 3-D HSI data from the perspective of spectral sequence, and we attempt to extract the spectral variation information as the spectrum motion feature. Then, we construct an unsupervised spectrum motion feature learning framework (SMF-UL), which can be pretrained on mass unlabeled HSI data to learn the knowledge about perceiving spectral variation. Furthermore, to achieve the expansion of source data for pretraining, we develop an extendable training dataset construction method, which can integrate HSIs of different sizes, the number of bands, and sensors into a unified training set to utilize the rapidly growing mass unlabeled HSI data effectively. Finally, we use the trained network to directly extract the spectrum motion feature of the target HSI for classification, so the laborious retraining of the network can be avoided. Extensive experiments show that the proposed SMF-UL acquires the robust capability of feature extraction with generalization through unsupervised learning on mass unlabeled HSI data, and the classification performance of extracted spectrum motion feature is competitive to advanced in-domain and cross-domain methods, which shows its flexibility and superiority. The code of SMF-UL will be open at https://github.com/sssssyf/ SMF-UL.

Self-Supervised Feature Learning Based on Spectral Masking for Hyperspectral Image Classification

Self-Supervised Learning With Multiscale Densely Connected Network for Hyperspectral Image Classification

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

S2HM2: A Spectral–Spatial Hierarchical Masked Modeling Framework for Self-Supervised Feature Learning and Classification of Large-Scale Hyperspectral Images

Instructional Mask Autoencoder: A Scalable Learner for Hyperspectral Image Classification

Self-Supervised Assisted Semi-Supervised Residual Network for Hyperspectral Image Classification

HSIMAE: A Unified Masked Autoencoder with Large-scale Pre-training for Hyperspectral Image Classification

Self-Supervised Learning With Adaptive Distillation for Hyperspectral Image Classification

Hyperspectral Classification Via Learnt Features

Semi-Supervised Feature Learning For Hyperspectral Image Classification

Semi-Supervised Hyperspectral Image Classification via Spatial-Regulated Self-Training

Semisupervised deep learning using consistency regularization and pseudolabels for hyperspectral image classification

Semi-Supervised Deep Learning Classification for Hyperspectral Image Based on Dual-Strategy Sample Selection

Perceiving Spectral Variation: Unsupervised Spectrum Motion Feature Learning for Hyperspectral Image Classification

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

Semi-Supervised Hyperspectral Image Classification Based on Multiscale Spectral–Spatial Graph Attention Network

Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification

Self-Supervised Learning With Prediction of Image Scale and Spectral Order for Hyperspectral Image Classification

Hyperspectral image classification using spectral-spatial LSTMs

Semi-supervised Feature Learning for Disjoint Hyperspectral Imagery Classification

MSMT-LCL: Multiscale Spatial-Spectral Masked Transformer With Local Contrastive Learning for Hyperspectral Image Classification