Abstract:Noisy label learning has been tackled with both discriminative and generative approaches. Despite the simplicity and efficiency of discriminative methods, generative models offer a more principled way of disentangling clean and noisy labels and estimating the label transition matrix. However, existing generative methods often require inferring additional latent variables through costly generative modules or heuristic assumptions, which hinder adaptive optimisation for different causal directions. They also assume a uniform clean label prior, which does not reflect the sample-wise clean label distribution and uncertainty. In this paper, we propose a novel framework for generative noisy label learning that addresses these challenges. First, we propose a new single-stage optimisation that directly approximates image generation by a discriminative classifier output. This approximation significantly reduces the computation cost of image generation, preserves the generative modelling benefits, and enables our framework to be agnostic in regards to different causality scenarios (i.e., image generate label or vice-versa). Second, we introduce a new Partial Label Supervision (PLS) for noisy label learning that accounts for both clean label coverage and uncertainty. The supervision of PLS does not merely aim at minimising loss, but seeks to capture the underlying sample-wise clean label distribution and uncertainty. Extensive experiments on computer vision and natural language processing (NLP) benchmarks demonstrate that our generative modelling achieves state-of-the-art results while significantly reducing the computation cost. Our code is available at <a class="link-external link-https" href="https://github.com/lfb-1/GNL" rel="external noopener nofollow">this https URL</a>.

Discriminatively-Tuned Generative Classifiers for Robust Natural Language Inference

Lost in Inference: Rediscovering the Role of Natural Language Inference for Large Language Models

Revisiting Discriminative Vs. Generative Classifiers: Theory and Implications

Natural Language Inference Using Lstm Model With Sentence Fusion

Improving Language Understanding by Generative Pre-Training

Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classification

Explaining Text Matching on Neural Natural Language Inference

A Universal Discriminator for Zero-Shot Generalization

An Empirical Study on Model-agnostic Debiasing Strategies for Robust Natural Language Inference.

A synthetic data approach for domain generalization of NLI models

KACE: Generating Knowledge-Aware Contrastive Explanations for Natural Language Inference

Discriminative Probing and Tuning for Text-to-Image Generation

In Search of the Long-Tail: Systematic Generation of Long-Tail Inferential Knowledge via Logical Rule Guided Search

Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation

Intriguing properties of generative classifiers

Partial Label Supervision for Agnostic Generative Noisy Label Learning

KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning

A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference

Abductive natural language inference by interactive model with structural loss

Generation-driven Contrastive Self-training for Zero-shot Text Classification with Instruction-following LLM

Multi-turn Inference Matching Network for Natural Language Inference