Abstract:Co-training, an advanced form of self-training, allows multiple base models to learn collaboratively, leading to superior performance in semi-supervised learning tasks. However, its widespread adoption is hindered by high computational costs and intricate design choices. To address these challenges, we present Multi-Head Co-Training, a streamlined and efficient framework that consolidates individual models into a multi-head structure, adding minimal extra parameters. Each classification head in this unified model collaborates with others via a “Weak and Strong Augmentation” strategy, with diversity organically introduced through robust data augmentation. Consequently, our approach implicitly promotes diversity while incurring only a minor increase in computational overhead, making co-training more accessible. We validate the effectiveness of Multi-Head Co-Training through an empirical study on standard semi-supervised learning benchmarks. For example, our method achieves up to a 3.1% accuracy improvement on the semi-supervised CIFAR dataset compared to recent methods.Recognizing the necessity for more practical performance metrics beyond accuracy, we assess our framework from three additional perspectives: robust generalization, uncertainty, and computational efficiency. To evaluate robust generalization, we expand the conventional SSL experimental setting to a more comprehensive open-set semi-supervised learning scenario. For uncertainty assessment, we conduct experiments on model calibration and selective classification benchmarks. For example, our method achieves up to a 4.3% accuracy improvement on the open-set semi-supervised CIFAR dataset. Our extensive experiments confirm that our proposed framework better captures prediction confidence and uncertainty, rendering it more suitable for SSL deployment in open environments. The code is available at https://github.com/chenmc1996/Multi-Head-Co-Training.

One of semi-supervised classification algorithm named Co-S3OM based on cooperative training

Dual-Classifier Collaborative Method Based on Semi-Supervised Active Learning

Semi-supervised Learning Combining Co-Training with Active Learning

Application of Supervised SOM Neural Network in Intrusion Detection

A Semi-supervised Collaboration Classification Algorithm with Enhanced Difference

Tri-Training: Exploiting Unlabeled Data Using Three Classifiers

Exploiting Ensemble Method in Semi-Supervised Learning

CISO: Co-iteration Semi-Supervised Learning for Visual Object Detection

Semi-Supervised Learning with Multi-Head Co-Training

A Novel Sub-Kmeans Based on Co-Training Approach by Transforming Single-View into Multi-View.

Semi-supervised regression via embedding space mapping and pseudo-label smearing

Deep Co-Training for Semi-Supervised Image Recognition

A Study on Application of Semi-Supervised Collaborative Classification Algorithm

Inductive Semi-Supervised Multi-Label Learning with Co-Training

Research of Semi-supervised Classification Algorithm Based on Tri-Training

Semi-Supervised Ensemble Classification Method Based On Near Neighbor And Its Application

Multi-head Co-Training: an Uncertainty-Aware and Robust Semi-Supervised Learning Framework

Stacked Co-Training for Semi-Supervised Multi-Label Learning

Development of Co-Training Support Vector Machine Model for Semi-Supervised Classification

An improved semi-supervised categorization algorithm based on mutual independence model

Multi-view Collaborative Semi-Supervised Classification Algorithm Based on Diversity Measurers of Classifier with the Combination of Agreement and Disagreement Label Rules