Abstract:Recently, deep learning (DL) presents a promising performance in the joint classification of multimodal remote sensing (RS) data. However, most of the approaches adopt a supervised learning (SL) manner, where the discrimination capability is limited by the paucity of labeled samples. Though some attempts have been made to develop semi-supervised methods, they prefer to select the highly confident predictions as pseudo-ground truth and discard those unreliable ones. Actually, unreliable samples can also provide useful information, e.g., indicating the categories to which samples may belong and definitely not belong. Focused on this, a novel uncertainty-aware contrastive learning (UACL) method is proposed. Here, label uncertainty analysis (UA) based on multilevel probability estimation is first conducted to separate reliable and unreliable samples, which are then processed with a designed hybrid ("hard" or "soft") contrastive learning (CL) strategy. For reliable samples, the "hard" CL pushes the network to learn features that will minimize the intra-class distance while maximizing the inter-class distance, according to the pseudo-labels. For unreliable samples, the "soft" CL aims to learn the similarity and difference among samples, where the predicted class probabilities are queried to estimate a soft mask for an adaptive feature similarity measurement. Moreover, a multimodal spectral-spatial joint feature representation pipeline of triple branches, i.e., one spectral branch for hyperspectral images (HSIs) and two spatial branches for multimodal data, is also introduced. By jointly learning from both labeled and unlabeled samples, more discriminative spectral-spatial feature representation will lead to a further boost in classification performance. Extensive experiments on four well-known multimodal datasets prove the effectiveness of the proposed semi-supervised classification method. Codes are available at https://github.com/Ding-Kexin/UACL.

Uncertainty measurement of partially labeled categorical data with application to semi-supervised attribute reduction

Semi-supervised attribute reduction for hybrid data

The degree of importance for partially labeled incomplete real-valued data with application to semi-supervised attribute reduction

Exploring measure of uncertainty via a discernibility relation for partially labeled real-valued data

Semi-supervised attribute reduction for partially labelled multiset-valued data via a prediction label strategy

New uncertainty measurement for hybrid data and its application in attribute reduction

Attribute Selection for Partially Labeled Categorical Data by Rough Set Approach.

Semi-Supervised Learning for Classification with Uncertainty

An Efficient Uncertainty Measure-based Attribute Reduction Approach for Interval-valued Data with Missing Values.

Hybrid Approaches to Attribute Reduction Based on Indiscernibility and Discernibility Relation

Discriminant Models for Uncertainty Characterization in Area Class Change Categorization

Uncertainty-Aware Contrastive Learning for Semi-Supervised Classification of Multimodal Remote Sensing Images

New uncertainty measurement for a decision table with application to feature selection

Semi-supervised Shadowed Sets for Three-Way Classification on Partial Labeled Data

Semi-supervised Dimensionality Reduction Using Estimated Class Membership Probabilities.

Attribute Reduction with Fuzzy Rough Self-Information Measures

Partial Label Dimensional Reduction Via Semantic Difference Information and Manifold Regularization.

A Novel Attribute Reduction Approach for Multi-Label Data Based on Rough Set Theory.

A Variable Precision Attribute Reduction Approach in Multilabel Decision Tables.

Uncertainty measurement for incomplete set-valued data with application to attribute reduction