Abstract:Recently, deep learning (DL) presents a promising performance in the joint classification of multimodal remote sensing (RS) data. However, most of the approaches adopt a supervised learning (SL) manner, where the discrimination capability is limited by the paucity of labeled samples. Though some attempts have been made to develop semi-supervised methods, they prefer to select the highly confident predictions as pseudo-ground truth and discard those unreliable ones. Actually, unreliable samples can also provide useful information, e.g., indicating the categories to which samples may belong and definitely not belong. Focused on this, a novel uncertainty-aware contrastive learning (UACL) method is proposed. Here, label uncertainty analysis (UA) based on multilevel probability estimation is first conducted to separate reliable and unreliable samples, which are then processed with a designed hybrid ("hard" or "soft") contrastive learning (CL) strategy. For reliable samples, the "hard" CL pushes the network to learn features that will minimize the intra-class distance while maximizing the inter-class distance, according to the pseudo-labels. For unreliable samples, the "soft" CL aims to learn the similarity and difference among samples, where the predicted class probabilities are queried to estimate a soft mask for an adaptive feature similarity measurement. Moreover, a multimodal spectral-spatial joint feature representation pipeline of triple branches, i.e., one spectral branch for hyperspectral images (HSIs) and two spatial branches for multimodal data, is also introduced. By jointly learning from both labeled and unlabeled samples, more discriminative spectral-spatial feature representation will lead to a further boost in classification performance. Extensive experiments on four well-known multimodal datasets prove the effectiveness of the proposed semi-supervised classification method. Codes are available at https://github.com/Ding-Kexin/UACL.

Learning classifier system using both labeled and unlabeled data.

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

SSXCS:Semi-supervised learning classifier system

Category-Level Regularized Unlabeled-to-Labeled Learning for Semi-supervised Prostate Segmentation with Multi-site Unlabeled Data

Efficient multi-class unlabeled constrained semi-supervised SVM.

Learning Classifier System Ensemble for Data Mining

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Uncertainty-Aware Contrastive Learning for Semi-Supervised Classification of Multimodal Remote Sensing Images

Class-Aware Contrastive Semi-Supervised Learning

UCSL: Toward Unsupervised Common Subspace Learning for Cross-Modal Image Classification

Semi-Supervised Classification with Universum

Local Weight Coupled Network: Multi-Modal Unequal Semi-Supervised Domain Adaptation.

Semi-Supervised Text Classification Using Positive and Unlabeled Data

Dual Learning for Semi-Supervised Natural Language Understanding

A unified framework for semi-supervised PU learning

ASCL: Accelerating semi‐supervised learning via contrastive learning

ESimCSE Unsupervised Contrastive Learning Jointly with UDA Semi-Supervised Learning for Large Label System Text Classification Mode

A survey on semi-supervised learning

Semi-supervised Learning for Code-Switching ASR with Large Language Model Filter

Semi-supervised support vector learning for face recognition

Learning From Semi-Supervised Weak-Label Data