Abstract:Label noise is ubiquitous in many real-world scenarios which often misleads training algorithm and brings about the degraded classification performance. Therefore, many approaches have been proposed to correct the loss function given corrupted labels to combat such label noise. Among them, a trend of works achieve this goal by unbiasedly estimating the data centroid, which plays an important role in constructing an unbiased risk estimator for minimization. However, they usually handle the noisy labels in different classes all at once, so the local information inherited by each class is ignored which often leads to unsatisfactory performance. To address this defect, this paper presents a novel robust learning algorithm dubbed "Class-Wise Denoising" (CWD), which tackles the noisy labels in a class-wise way to ease the entire noise correction task. Specifically, two virtual auxiliary sets are respectively constructed by presuming that the positive and negative labels in the training set are clean, so the original false-negative labels and false-positive ones are tackled separately. As a result, an improved centroid estimator can be designed which helps to yield more accurate risk estimator. Theoretically, we prove that: 1) the variance in centroid estimation can often be reduced by our CWD when compared with existing methods with unbiased centroid estimator; and 2) the performance of CWD trained on the noisy set will converge to that of the optimal classifier trained on the clean set with a convergence rate O(1/vn) )where n is the number of the training examples. These sound theoretical properties critically enable our CWD to produce the improved classification performance under label noise, which is also demonstrated by the comparisons with ten representative state-of-the-art methods on a variety of benchmark datasets.

Multi-task Label Noise Learning for Classification

Multi-class Label Noise Learning via Loss Decomposition and Centroid Estimation

Learning from Noisy Labels with Decoupled Meta Label Purifier

Towards Robust Multi-Label Learning Against Dirty Label Noise

Enhancing Multi-Label Text Classification under Label-Dependent Noise: A Label-Specific Denoising Framework

Learning from Noisy Labels with Noise Modeling Network

Class-Wise Denoising for Robust Learning under Label Noise

Landmark-based Partial Multi-label Learning with Noise Processing.

Multi-category classification with label noise by robust binary loss

Positive Label Is All You Need for Multi-Label Classification

Category-Adaptive Label Discovery and Noise Rejection for Multi-label Recognition with Partial Positive Labels

Holistic Label Correction for Noisy Multi-Label Classification

Hybrid Noise-Oriented Multilabel Learning.

Two-stage Natural Scene Image Classification with Noise Discovering and Label-Correlation Mining

Noisy Label Tolerance: A New Perspective of Partial Multi-Label Learning.

Training Noise-Robust Deep Neural Networks Via Meta-Learning

CoocNet: a Novel Approach to Multi-Label Text Classification with Improved Label Co-Occurrence Modeling

Online Multi-Label Classification under Noisy and Changing Label Distribution

Neighborhood Collective Estimation for Noisy Label Identification and Correction

Multi-task learning with self-learning weight for image denoising

Hierarchical Noise-Tolerant Meta-Learning With Noisy Labels