Abstract:Recently, many benchmark datasets have been found to contain noisy labels caused by unavoidable human mistakes. Many researchers propose new noise-aware loss functions to achieve robust classification performance. However, we discover that existing noise-aware loss functions cannot fully heal the damage caused by the noise. On the other hand, some methods filter out low confidence samples and train new models, whereas the filtered samples contain both noisy and hard samples that are critical for the robustness of models. Based on the above two discoveries, we devised the Noise-aware Network (NA-Net) for robust training with noisy labels. Each layer of NA-Net contains three groups of convolution kernels responsible for mix samples, clean samples, and noisy samples, termed as mix-kernels, clean-kernels, and noise-kernels, respectively. Mix-kernels are used for finding the clean samples with a newly devised noise-immune (NI) loss function; clean-kernels are targeted at learning better features without being misguided by noise; noise-kernels are trained by the remaining samples to rectify wrong labels for the next iteration. Meanwhile, for increasing the classification performance of mix-kernels, the extracted feature maps of clean-kernels without being poisoned are combined as the input of mix-kernels of the next layer. Also, the knowledge distillation strategy is adopted to distill the knowledge from clean-kernels to the noise-kernels. Extensive experiments demonstrate that the mutual promotion of three groups of kernels in NA-Net achieves state-of-the-art performance on both artificial noisy datasets and real-world datasets.

Making Deep Neural Networks Robust to Label Noise: Cross-Training with a Novel Loss Function

Cross-Training Deep Neural Networks for Learning from Label Noise

Making Deep Neural Networks Robust to Label Noise: A Reweighting Loss and Data Filtration

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Making Deep Neural Networks Robust to Label Noise: a Loss Correction Approach

Learning from Noisy Labels with Complementary Loss Functions

Progressively Robust Loss for Deep Learning with Noisy Labels

DAT: Training Deep Networks Robust to Label-Noise by Matching the Feature Distributions

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Co-LDL: A Co-Training-Based Label Distribution Learning Method for Tackling Label Noise

Trimmed Robust Loss Function for Training Deep Neural Networks with Label Noise

An Ensemble Noise-Robust K-fold Cross-Validation Selection Method for Noisy Labels

Towards Robust Graph Neural Networks against Label Noise

Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labels

A Convergence Path to Deep Learning on Noisy Labels

Synergistic Network Learning and Label Correction for Noise-robust Image Classification

Can Cross Entropy Loss Be Robust to Label Noise?

Learning from Noisy Labels Via Dynamic Loss Thresholding

A Robust Classifier for Noise-corruption Learning

Training Noise-Robust Deep Neural Networks Via Meta-Learning

Mutual calibration training: Training deep neural networks with noisy labels using dual-models