Abstract:In recent times, deep learning models have achieved state-of-the-art performances in image classification. However, the classification and generalization ability of most achievements have highly relied on the availability of large-scale accurate labeled training data, which are time-consuming, laborious, and expensive to collect. Moreover, in the generalizing process of deep learning models, the noisy labels are the challenges for multi-category classification. Hence, it is essential to explore effective methods that can efficiently and correctly train deep models under label noise to conduct multi-category classification. This paper proposes using robust binary loss functions to train deep models under label noise to address this problem. Specifically, we suggest handling the K-class classification task by using K binary classifiers, which can be completed by a joint adoption of multi-category large margin classification approaches, e.g., Pairwise-Comparison (PC) or One-versus-All (OVA). We also theoretically demonstrate that our method is inherently tolerant to label noise by using symmetric binary loss functions in multi-category classification tasks. Moreover, we designed a truncated CCE loss to combine with the proposed losses to improve the learning ability. Finally, we test our method on three different benchmark datasets with different types of label noise. The experimental results have clearly confirmed the effectiveness of our method, which can reduce the negative effect of noisy labels and improve the generalization ability.

Learning from Noisy Labels with Complementary Loss Functions

Symmetric Cross Entropy for Robust Learning With Noisy Labels

Progressively Robust Loss for Deep Learning with Noisy Labels

Learning with Noisy Labels Via Sparse Regularization

Can Cross Entropy Loss Be Robust to Label Noise?

Mitigating Memorization of Noisy Labels by Clipping the Model Prediction

Normalized Loss Functions for Deep Learning with Noisy Labels

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

Extending Ordinary-Label Learning Losses to Complementary-Label Learning.

Learning with noisy labels via logit adjustment based on gradient prior method

Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels

Robust Loss Functions under Label Noise for Deep Neural Networks

On Better Detecting and Leveraging Noisy Samples for Learning with Severe Label Noise

Making Deep Neural Networks Robust to Label Noise: A Reweighting Loss and Data Filtration

Noisy Label Learning with Provable Consistency for a Wider Family of Losses.

An joint end-to-end framework for learning with noisy labels

Trimmed Robust Loss Function for Training Deep Neural Networks with Label Noise

Multi-category classification with label noise by robust binary loss