Abstract:Feature noise and label noise are ubiquitous in practical scenarios, which pose great challenges for training a robust machine learning model. Most previous approaches usually deal with only a single problem of either feature noise or label noise. However, in real-world applications, hybrid noise, which contains both feature noise and label noise, is very common due to the unreliable data collection and annotation processes. Although some results have been achieved by a few representation learning based attempts, this issue is still far from being addressed with promising performance and guaranteed theoretical analyses. To address the challenge, we propose a novel unified learning framework called "Feature and Label Recovery" (FLR) to combat the hybrid noise from the perspective of data recovery, where we concurrently reconstruct both the feature matrix and the label matrix of input data. Specifically, the clean feature matrix is discovered by the low-rank approximation, and the ground-truth label matrix is embedded based on the recovered features with a nuclear norm regularization. Meanwhile, the feature noise and label noise are characterized by their respective adaptive matrix norms to satisfy the corresponding maximum likelihood. As this framework leads to a non-convex optimization problem, we develop the non-convex Alternating Direction Method of Multipliers (ADMM) with the convergence guarantee to solve our learning objective. We also provide the theoretical analysis to show that the generalization error of FLR can be upper-bounded in the presence of hybrid noise. Experimental results on several typical benchmark datasets clearly demonstrate the superiority of our proposed method over the state-of-the-art robust learning approaches for various noises.

ACE: A Coarse-to-Fine Learning Framework for Reliable Representation Learning Against Label Noise

A Label Noise Robust Stacked Auto-Encoder Algorithm for Inaccurate Supervised Classification Problems

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

Adaptive Contrastive Learning for Learning Robust Representations under Label Noise.

Learning with Noisy Labels Via Self-supervised Adversarial Noisy Masking

Learning from Noisy Labels with Coarse-to-Fine Sample Credibility Modeling

Decoupling Representation and Classifier for Noisy Label Learning

IDEAL: High-Order-Ensemble Adaptation Network for Learning with Noisy Labels

Feature-Induced Label Distribution for Learning with Noisy Labels

Robust Learning under Hybrid Noise

Towards harnessing feature embedding for robust learning with noisy labels

An joint end-to-end framework for learning with noisy labels

Co-Learning Meets Stitch-Up for Noisy Multi-label Visual Recognition

ULAREF: A Unified Label Refinement Framework for Learning with Inaccurate Supervision

Learning with Neighbor Consistency for Noisy Labels

LABELNET: Recovering Noisy Labels

Robust Feature Learning Against Noisy Labels

ERASE: Error-Resilient Representation Learning on Graphs for Label Noise Tolerance

Learning from Noisy Labels Via Meta Credible Label Elicitation.

Embedding Label Structures for Fine-Grained Feature Representation

Intelligent agent for hyperspectral image classification with noisy labels: a deep reinforcement learning framework