Abstract:To cleanse mislabeled examples from a training dataset for efficient and effective induction, most existing approaches adopt a major set oriented scheme: the training dataset is separated into two parts (a major set and a minor set). The classifiers learned from the major set are used to identify noise in the minor set. The obvious drawbacks of such a scheme are twofold: (1) when the underlying data volume keeps growing, it would be either physically impossible or time consuming to load the major set into the memory for inductive learning; and (2) for multiple or distributed datasets, it can be either technically infeasible or factitiously forbidden to download data from other sites (for security or privacy reasons). Therefore, these approaches have severe limitations in conducting effective global data cleansing from large, distributed datasets.In this paper, we propose a solution to bridge the local and global analysis for noise cleansing. More specifically, the proposed effort tries to identify and eliminate mislabeled data items from large or distributed datasets through local analysis and global incorporation. For this purpose, we make use of distributed datasets or partition a large dataset into subsets, each of which is regarded as a local subset and is small enough to be processed by an induction algorithm at one time to construct a local model for noise identification. We construct good rules from each subset, and use the good rules to evaluate the whole dataset. For a given instance I-k , two error count variables are used to count the number of times it has been identified as noise by all data subsets. The instance with higher error values will have a higher probability of being a mislabeled example. Two threshold schemes, majority and non-objection, are used to identify and eliminate the noisy examples. Experimental results and comparative studies on both real-world and synthetic datasets are reported to evaluate the effectiveness and efficiency of the proposed approach.

Identifying and Correcting Mislabeled Training Instances

Identifying and Correcting Mislabled Training Instances Using Bayes

COMIRE: A Consistence-Based Mislabeled Instances Removal Method

OT Cleaner: Label Correction As Optimal Transport

Interactive Correction of Mislabeled Training Data

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

Detection and Correction of Mislabeled Training Samples for Hyperspectral Image Classification

Instance Correction for Learning with Open-set Noisy Labels

Identification and Correction of Mislabeled Training Data for Land Cover Classification Based on Ensemble Margin

MisDetect: Iterative Mislabel Detection Using Early Loss

Error-Bounded Correction of Noisy Labels

Detecting Label Errors in Token Classification Data

Identifying And Correcting Mislabeled Satellite Image Data By Iterative Ordering Of Ensemble Margins

Improved Naive Bayes with Mislabeled Data.

Label noise correction methods

Bridging Local and Global Data Cleansing: Identifying Class Noise in Large, Distributed Data Datasets

Identifying Mislabeled Data using the Area Under the Margin Ranking

Label Correction For Sketch-Based 3d Shape Retrieval.

Learning from Training Dynamics: Identifying Mislabeled Data Beyond Manually Designed Features.

IDE: A System for Iterative Mislabel Detection

Learning from training dynamics: Identifying mislabeled data beyond manually designed features