Abstract:Summary SSL (semi‐supervised learning) is widely used in machine learning, which leverages labeled and unlabeled data to improve model performance. SSL aims to optimize class mutual information, but noisy pseudo‐labels introduce false class information due to the scarcity of labels. Therefore, these algorithms often need significant training time to refine pseudo‐labels for performance improvement iteratively. To tackle this challenge, we propose a novel plug‐and‐play method named Accelerating semi‐supervised learning via contrastive learning (ASCL). This method combines contrastive learning with uncertainty‐based selection for performance improvement and accelerates the convergence of SSL algorithms. Contrastive learning initially emphasizes the mutual information between samples as a means to decrease dependence on pseudo‐labels. Subsequently, it gradually turns to maximizing the mutual information between classes, aligning with the objective of semi‐supervised learning. Uncertainty‐based selection provides a robust mechanism for acquiring pseudo‐labels. The combination of the contrastive learning module and the uncertainty‐based selection module forms a virtuous cycle to improve the performance of the proposed model. Extensive experiments demonstrate that ASCL outperforms state‐of‐the‐art methods in terms of both convergence efficiency and performance. In the experimental scenario where only one label is assigned per class in the CIFAR‐10 dataset, the application of ASCL to Pseudo‐label, UDA (unsupervised data augmentation for consistency training), and Fixmatch benefits substantial improvements in classification accuracy. Specifically, the results demonstrate notable improvements in respect of 16.32%, 6.9%, and 24.43% when compared to the original outcomes. Moreover, the required training time is reduced by almost 50%.

Towards Discovering the Effectiveness of Moderately Confident Samples for Semi-Supervised Learning

Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised Learning

Towards Self-Adaptive Pseudo-Label Filtering for Semi-Supervised Learning

VCC-INFUSE: Towards Accurate and Efficient Selection of Unlabeled Examples in Semi-supervised Learning

Meta-Semi: A Meta-learning Approach for Semi-supervised Learning.

Enhancing Sample Utilization Through Sample Adaptive Augmentation in Semi-Supervised Learning

Generalized Semi-Supervised Learning via Self-Supervised Feature Adaptation

Progressive Feature Adjustment for Semi-supervised Learning from Pretrained Models

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

When Semi-Supervised Learning Meets Transfer Learning: Training Strategies, Models and Datasets.

On Improving the Algorithm-, Model-, and Data- Efficiency of Self-Supervised Learning

LaSSL: Label-Guided Self-Training for Semi-supervised Learning

SSL++: Improving Self-Supervised Learning by Mitigating the Proxy Task-Specificity Problem

Towards the Mitigation of Confirmation Bias in Semi-supervised Learning: a Debiased Training Perspective

Boosting Semi-Supervised Learning by Exploiting All Unlabeled Data

ASCL: Accelerating semi‐supervised learning via contrastive learning

Label Diagnosis Through Self Tuning for Web Image Search

Semi-supervised learning by selective training with pseudo labels via confidence estimation

Self-Tuning for Data-Efficient Deep Learning

FlexSSL : A Generic and Efficient Framework for Semi-Supervised Learning

The Common Stability Mechanism behind most Self-Supervised Learning Approaches