Abstract:Machine learning techniques often have to deal with noisy data, which may affect the accuracy of the resulting data models. Therefore, effectively dealing with noise is a key aspect in supervised learning to obtain reliable models from data. Although several authors have studied the effect of noise for some particular learners, comparisons of its effect among different learners are lacking. In this paper, we address this issue by systematically comparing how different degrees of noise affect four supervised learners that belong to different paradigms. Specifically, we consider the Naïve Bayes probabilistic classifier, the C4.5 decision tree, the IBk instance-based learner and the SMO support vector machine. We have selected four methods which enable us to contrast different learning paradigms, and which are considered to be four of the top ten algorithms in data mining (Yu et al. 2007). We test them on a collection of data sets that are perturbed with noise in the input attributes and noise in the output class. As an initial hypothesis, we assign the techniques to two groups, NB with C4.5 and IBk with SMO, based on their proposed sensitivity to noise, the first group being the least sensitive. The analysis enables us to extract key observations about the effect of different types and degrees of noise on these learning techniques. In general, we find that Naïve Bayes appears as the most robust algorithm, and SMO the least, relative to the other two techniques. However, we find that the underlying empirical behavior of the techniques is more complex, and varies depending on the noise type and the specific data set being processed. In general, noise in the training data set is found to give the most difficulty to the learners.

A Study on the Noise Label Influence in Boosting Algorithms: AdaBoost, GBM and XGBoost

Boosting in the presence of label noise

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Non-Convex Boosting Overcomes Random Label Noise

A study of the effect of different types of noise on the precision of supervised learning techniques

Training Gradient Boosted Decision Trees on Tabular Data Containing Label Noise for Classification Tasks

Improved Boosting Algorithm With Adaptive Filtration

Analyze the Robustness of Classifiers under Label Noise

Model-agnostic Approaches to Handling Noisy Labels When Training Sound Event Classifiers

Task-Adaptive Pre-Training for Boosting Learning With Noisy Labels: A Study on Text Classification for African Languages

The success of AdaBoost and its application in portfolio management

NoisyAG-News: A Benchmark for Addressing Instance-Dependent Noise in Text Classification

Decoding class dynamics in learning with noisy labels

Improving Noise Robustness through Abstractions and its Impact on Machine Learning

A Unified Framework for Connecting Noise Modeling to Boost Noise Detection

Untangling AdaBoost-based Cost-Sensitive Classification. Part I: Theoretical Perspective

A more robust boosting algorithm

Navigating Noise: A Study of How Noise Influences Generalisation and Calibration of Neural Networks

A boosting method to detect noisy data

Asymmetric Loss Functions for Noise-Tolerant Learning: Theory and Applications

Which Strategies Matter for Noisy Label Classification? Insight into Loss and Uncertainty