Abstract:Noisy label learning has been tackled with both discriminative and generative approaches. Despite the simplicity and efficiency of discriminative methods, generative models offer a more principled way of disentangling clean and noisy labels and estimating the label transition matrix. However, existing generative methods often require inferring additional latent variables through costly generative modules or heuristic assumptions, which hinder adaptive optimisation for different causal directions. They also assume a uniform clean label prior, which does not reflect the sample-wise clean label distribution and uncertainty. In this paper, we propose a novel framework for generative noisy label learning that addresses these challenges. First, we propose a new single-stage optimisation that directly approximates image generation by a discriminative classifier output. This approximation significantly reduces the computation cost of image generation, preserves the generative modelling benefits, and enables our framework to be agnostic in regards to different causality scenarios (i.e., image generate label or vice-versa). Second, we introduce a new Partial Label Supervision (PLS) for noisy label learning that accounts for both clean label coverage and uncertainty. The supervision of PLS does not merely aim at minimising loss, but seeks to capture the underlying sample-wise clean label distribution and uncertainty. Extensive experiments on computer vision and natural language processing (NLP) benchmarks demonstrate that our generative modelling achieves state-of-the-art results while significantly reducing the computation cost. Our code is available at <a class="link-external link-https" href="https://github.com/lfb-1/GNL" rel="external noopener nofollow">this https URL</a>.

Towards Unbiased Exploration in Partial Label Learning

Positive and Unlabeled Learning through Negative Selection and Imbalance-aware Classification

A Generalized Unbiased Risk Estimator for Learning with Augmented Classes.

Partial-Label Learning with a Reject Option

Learning with Biased Complementary Labels

Towards Imbalanced Large Scale Multi-label Classification with Partially Annotated Labels

Partial-Label Regression

Exploiting Unlabeled Data via Partial Label Assignment for Multi-Class Semi-Supervised Learning

An Unbiased Risk Estimator for Partial Label Learning with Augmented Classes

Generating Unbiased Pseudo-labels via a Theoretically Guaranteed Chebyshev Constraint to Unify Semi-supervised Classification and Regression

Partial Label Supervision for Agnostic Generative Noisy Label Learning

Debiased Pseudo Labeling in Self-Training

Long-Tailed Partial Label Learning Via Dynamic Rebalancing

Learning From Biased Soft Labels

PLM: Partial Label Masking for Imbalanced Multi-label Classification

Uncertainty-aware Pseudo-label Selection for Positive-Unlabeled Learning

Adversary-Aware Partial label learning with Label distillation

Prototype-Anchored Learning for Learning with Imperfect Annotations

On Characterizing and Mitigating Imbalances in Multi-Instance Partial Label Learning

Discovering Bias in Latent Space: An Unsupervised Debiasing Approach

Addressing the multi-label imbalance for neural networks: An approach based on stratified mini-batches