Abstract:Label noise is ubiquitous in many real-world scenarios which often misleads training algorithm and brings about the degraded classification performance. Therefore, many approaches have been proposed to correct the loss function given corrupted labels to combat such label noise. Among them, a trend of works achieve this goal by unbiasedly estimating the data centroid, which plays an important role in constructing an unbiased risk estimator for minimization. However, they usually handle the noisy labels in different classes all at once, so the local information inherited by each class is ignored which often leads to unsatisfactory performance. To address this defect, this paper presents a novel robust learning algorithm dubbed "Class-Wise Denoising" (CWD), which tackles the noisy labels in a class-wise way to ease the entire noise correction task. Specifically, two virtual auxiliary sets are respectively constructed by presuming that the positive and negative labels in the training set are clean, so the original false-negative labels and false-positive ones are tackled separately. As a result, an improved centroid estimator can be designed which helps to yield more accurate risk estimator. Theoretically, we prove that: 1) the variance in centroid estimation can often be reduced by our CWD when compared with existing methods with unbiased centroid estimator; and 2) the performance of CWD trained on the noisy set will converge to that of the optimal classifier trained on the clean set with a convergence rate O(1/vn) )where n is the number of the training examples. These sound theoretical properties critically enable our CWD to produce the improved classification performance under label noise, which is also demonstrated by the comparisons with ten representative state-of-the-art methods on a variety of benchmark datasets.

LDAAD: an Effective Label De-noising Approach for Anomaly Detection

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

Learning Discrimination from Contaminated Data: Multi-Instance Learning for Unsupervised Anomaly Detection

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

AnoRand: A Semi Supervised Deep Learning Anomaly Detection Method by Random Labeling

Improving deep label noise learning with dual active label correction

Meta pseudo labels for anomaly detection via partially observed anomalies

Label-Efficient Interactive Time-Series Anomaly Detection

FUN-AD: Fully Unsupervised Learning for Anomaly Detection with Noisy Training Data

Active Label-Denoising Algorithm Based on Broad Learning for Annotation of Machine Health Status

BadLabel: A Robust Perspective on Evaluating and Enhancing Label-noise Learning

Spiking Reinforcement Learning for Weakly-Supervised Anomaly Detection

Robust Mechanical Fault Diagnosis with Noisy Label Based on Multistage True Label Distribution Learning.

Label Noise Cleaning with an Adaptive Ensemble Method Based on Noise Detection Metric

Anomaly Detection with Partially Observed Anomalies

Feature-Induced Label Distribution for Learning with Noisy Labels

LABELNET: Recovering Noisy Labels

LAFD-Net: Learning with Noisy Pseudo-Labels for Semisupervised Bearing Fault Diagnosis

Class-Wise Denoising for Robust Learning under Label Noise

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise