Abstract:Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for hyperspectral remote sensing imagery. We evaluate the method's performance for both the single-label and multi-label classification tasks, particularly under scenarios of limited training data. The methodology unfolds in two stages. Initially, we focus on training an encoder and a projection network using a contrastive learning approach. This step is crucial for enhancing the ability of the encoder to discern patterns within the unlabelled data. Next, we employ the pre-trained encoder to guide the training of two distinct predictors: one for multi-label and another for single-label classification. Empirical results on four public datasets show that the predictors trained with our method perform better than those trained under fully supervised techniques. Notably, the performance is maintained even when the amount of training data is reduced by $50\%$. This advantage is consistent across both tasks. The method's effectiveness comes from its streamlined architecture. This design allows for retraining the encoder along with the predictor. As a result, the encoder becomes more adaptable to the features identified by the classifier, improving the overall classification performance. Qualitative analysis reveals the contrastive-learning-based encoder's capability to provide representations that allow separation among classes and identify location-based features despite not being explicitly trained for that. This observation indicates the method's potential in uncovering implicit spatial information within the data.

Unlocking the Potential of Data Augmentation in Contrastive Learning for Hyperspectral Image Classification

Boosting Unsupervised Contrastive Learning Using Diffusion-Based Data Augmentation from Scratch

ContrastNet: Unsupervised Feature Learning by Autoencoder and Prototypical Contrastive Learning for Hyperspectral Imagery Classification.

Data Augmentation for Hyperspectral Image Classification With Deep CNN

ROBYOL: Random-Occlusion-Based BYOL for Hyperspectral Image Classification

Enhancing Contrastive Learning with Positive Pair Mining for Few-shot Hyperspectral Image Classification

Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification

An Unsupervised Band Selection Method Via Contrastive Learning for Hyperspectral Images

Light-Weight Self-Supervised Contrastive Learning Network for Small Sample Hyperspectral Image Classification

Adaptive Data Augmentation for Contrastive Learning

Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification

Feature Augmentation for Self-supervised Contrastive Learning: A Closer Look

Adversarial Domain Alignment With Contrastive Learning for Hyperspectral Image Classification

Nearest Neighbor-Based Contrastive Learning for Hyperspectral and LiDAR Data Classification

Enhancing Hyperspectral Image Classification: Leveraging Unsupervised Information With Guided Group Contrastive Learning

Enhancing Hyperspectral Image Prediction with Contrastive Learning in Low-Label Regime

Deep Spatial-Spectral Subspace Clustering for Hyperspectral Images Based on Contrastive Learning

Cross-View-Prediction: Exploring Contrastive Feature for Hyperspectral Image Classification

HyperBT: Redundancy Reduction-Based Self-Supervised Learning for Hyperspectral Image Classification

Exploring Data Augmentations on Self-/Semi-/Fully- Supervised Pre-trained Models

Self-Supervised Contrastive Learning Residual Network for Hyperspectral Image Classification under Limited Labeled Samples