Abstract:Summary SSL (semi‐supervised learning) is widely used in machine learning, which leverages labeled and unlabeled data to improve model performance. SSL aims to optimize class mutual information, but noisy pseudo‐labels introduce false class information due to the scarcity of labels. Therefore, these algorithms often need significant training time to refine pseudo‐labels for performance improvement iteratively. To tackle this challenge, we propose a novel plug‐and‐play method named Accelerating semi‐supervised learning via contrastive learning (ASCL). This method combines contrastive learning with uncertainty‐based selection for performance improvement and accelerates the convergence of SSL algorithms. Contrastive learning initially emphasizes the mutual information between samples as a means to decrease dependence on pseudo‐labels. Subsequently, it gradually turns to maximizing the mutual information between classes, aligning with the objective of semi‐supervised learning. Uncertainty‐based selection provides a robust mechanism for acquiring pseudo‐labels. The combination of the contrastive learning module and the uncertainty‐based selection module forms a virtuous cycle to improve the performance of the proposed model. Extensive experiments demonstrate that ASCL outperforms state‐of‐the‐art methods in terms of both convergence efficiency and performance. In the experimental scenario where only one label is assigned per class in the CIFAR‐10 dataset, the application of ASCL to Pseudo‐label, UDA (unsupervised data augmentation for consistency training), and Fixmatch benefits substantial improvements in classification accuracy. Specifically, the results demonstrate notable improvements in respect of 16.32%, 6.9%, and 24.43% when compared to the original outcomes. Moreover, the required training time is reduced by almost 50%.

OCI-SSL: Open Class-Imbalanced Semi-Supervised Learning with Contrastive Learning

A Survey of Class-Imbalanced Semi-Supervised Learning

BaCon: Boosting Imbalanced Semi-supervised Learning via Balanced Feature-Level Contrastive Learning

Class-Aware Contrastive Semi-Supervised Learning

Boosting Semi-Supervised Learning with Contrastive Complementary Labeling

IOMatch: Simplifying Open-Set Semi-Supervised Learning with Joint Inliers and Outliers Utilization

An Empirical Study and Analysis on Open-Set Semi-Supervised Learning

ABC: Auxiliary Balanced Classifier for Class-imbalanced Semi-supervised Learning

Improvement of Semi-Supervised Learning in Real Application Scenarios

ASCL: Accelerating semi‐supervised learning via contrastive learning

An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learning

Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding.

SCOMatch: Alleviating Overtrusting in Open-set Semi-supervised Learning

Exploration and Exploitation of Unlabeled Data for Open-Set Semi-Supervised Learning

Trash to Treasure: Harvesting OOD Data with Cross-Modal Matching for Open-Set Semi-Supervised Learning

Semi-Supervised Learning via Weight-aware Distillation under Class Distribution Mismatch

DeCAB: Debiased Semi-supervised Learning for Imbalanced Open-Set Data.

SSB: Simple but Strong Baseline for Boosting Performance of Open-Set Semi-Supervised Learning

DCRP: Class-Aware Feature Diffusion Constraint and Reliable Pseudo-Labeling for Imbalanced Semi-Supervised Learning

On Pseudo-Labeling for Class-Mismatch Semi-Supervised Learning

CoSSL: Co-Learning of Representation and Classifier for Imbalanced Semi-Supervised Learning