Abstract:Semi-supervised learning (SSL) is a widely used model training paradigm that effectively utilizes a limited set of labeled data and a substantially larger pool of unlabeled data. Historically, the focus of SSL research has predominantly been on classification tasks, employing methods such as consistency regularization and pseudo-labeling. However, the direct application of these methods to regression tasks presents significant challenges, primarily due to the complexities associated with evaluating the reliability of pseudo-labels in a regression context. This paper introduces SimRegMatch, a novel semi-supervised regression (SSR) framework devised to overcome this specific challenge, by combining an uncertainty-based filtering mechanism with a similarity-based pseudo-label calibration approach. The former component is tasked with discerning which unlabeled examples possess pseudo-labels of sufficient reliability, achieved through the estimation of uncertainty levels. The latter component then refines these pseudo-labels by propagating information from labeled to unlabeled examples, thereby enhancing the overall quality of the pseudo-labels. The efficacy of SimRegMatch was rigorously tested through experiments conducted on the publicly available AgeDB dataset, which is centered around age prediction, as well as on a practical regression problem focused on the detection of interior noise levels in automobiles using accelerometer data. When benchmarked against current state-of-the-art methods in semi-supervised regression, SimRegMatch exhibited notable improvements in regression performance. Additionally, a series of ablation studies were carried out to dissect and understand the specific elements of the framework that were instrumental in achieving these performance enhancements. SimRegMatch addresses a pivotal issue in semi-supervised regression - the assessment of regression pseudo-label reliability - and substantially elevates model performance. By combining the strengths of uncertainty estimation and pseudo-label calibration, SimRegMatch emerges as a robust and versatile framework with significant potential for broad applicability in various SSR scenarios. A PyTorch implementation is publicly available at https://github.com/YongwonJo/SimRegMatch .

Semi-supervised Regression with Data Partitioning and Feature Mapping

Semi-supervised Node Splitting for Random Forest Construction

Semi-supervised Contrastive Regression for Pharmaceutical Processes

Adaptive Semi-Supervised Learning with Discriminative Least Squares Regression

Semi-supervised regression via embedding space mapping and pseudo-label smearing

Semi-Supervised Kernel Regression

Semi-Supervised Feature Selection Via Sparse Rescaled Linear Square Regression.

Random forest construction with robust semisupervised node splitting.

Semi-Supervised Classification Based on Robust Path Regularization

Single-image super-resolution based on semi-supervised learning

Discriminative and robust least squares regression for semi-supervised image classification

<i>Divideup</i>: A Generic Improvement Approach for Supervised Learning Using Dataset Partition with Finer Semantical Information

Learning Semi-Riemannian Metrics for Semisupervised Feature Extraction

Semi-Supervised Subspace Learning for Pattern Classification via Robust Low Rank Constraint

Deep semi-supervised regression via pseudo-label filtering and calibration

Semisupervised Clustering by Iterative Partition and Regression with Neuroscience Applications

Semi-supervised regression with label-guided adaptive graph optimization

Boosting Semi-Supervised Learning under Imbalanced Regression Via Pseudo-Labeling

Semi-Supervised Graph Imbalanced Regression

A New Supervised Image Classification Using Data Set Partition

Adaptive Semi-Supervised Feature Selection for Cross-Modal Retrieval