Abstract:In the era of big data, the data in many business scenarios are characterized by a small number of labelled samples and a large number of unlabelled samples. It is quite difficult to classify and identify such data and provide effective decision support for a business. A commonly employed processing method in this kind of data scenario is the disagreement-based semisupervised learning method, i.e., exchanging high-confidence samples among multiple models as pseudolabel samples to improve each model’s classification performance. As such pseudolabel samples inevitably contain label noise, they may interfere with the subsequent model learning and damage the robustness of the ensemble model. To solve this problem, a semisupervised classification algorithm based on noise learning theory and a disagreement cotraining framework is proposed. In this model, first, the probably approximately correct (PAC) estimation theory under label noise conditions is applied, the relationship between the label noise level and model robust estimation in the process of multiround cotraining is discussed, and a disagreement elimination algorithm framework based on multiple-model (feature argument and select (FANS) algorithm and L1 penalized logistics regression (PLR) algorithm) cotraining is constructed based on this theoretical relationship. The experimental results show that the algorithm proposed in this paper gives not only a high-confidence sample set that meets the upper bound constraint of the label noise level but also a robust ensemble model capable of resisting sampling bias. The work performed in this paper provides a new research perspective for semisupervised learning theory based on disagreement.

Semi-Supervised Learning: Exploiting Unlabeled Data with Symmetrical Distribution and High Confidence

Semi-Supervised Ensemble Classification Method Based On Near Neighbor And Its Application

Semi-supervised Salient Object Detection with Effective Confidence Estimation

A Semisupervised Classification Algorithm Combining Noise Learning Theory and a Disagreement Cotraining Framework.

Adaptive Semi-Supervised Learning with Discriminative Least Squares Regression

Semi-Supervised Partial Label Learning via Confidence-Rated Margin Maximization

Semi-supervised learning with extremely sparse labeled data on multiple semi-supervised assumptions

Improving Semi-Supervised Support Vector Machines Through Unlabeled Instances Selection.

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

Semi-supervised Learning Combining Co-Training with Active Learning

Adaptive Matrix Sketching and Clustering for Semisupervised Incremental Learning

Confidence Estimation Using Unlabeled Data

A method on selecting reliable samples based on fuzziness in positive and unlabeled learning

A Semi-Supervised Learning Algorithm Via Adaptive Laplacian Graph

Semi-supervised learning by selective training with pseudo labels via confidence estimation

Large-Scale Adaptive Semi-Supervised Learning Via Unified Inductive And Transductive Model

Semi-supervised Distribution Learning

Pseudo-label Selection for Deep Semi-supervised Learning

Iterative Nearest Neighborhood Oversampling in Semisupervised Learning from Imbalanced Data

Shrinking Class Space for Enhanced Certainty in Semi-Supervised Learning

Fairness in Semi-supervised Learning: Unlabeled Data Help to Reduce Discrimination