Abstract:In many situations, sample data is obtained from a noisy or imperfect source. In order to address such corruptions, this paper introduces the concept of a sampling corrector. Such algorithms use structure that the distribution is purported to have, in order to allow one to make on-the-fly corrections to samples drawn from probability distributions. These algorithms then act as filters between the noisy data and the end user. We show connections between sampling correctors, distribution learning algorithms, and distribution property testing algorithms. We show that these connections can be utilized to expand the applicability of known distribution learning and property testing algorithms as well as to achieve improved algorithms for those tasks. As a first step, we show how to design sampling correctors using proper learning algorithms. We then focus on the question of whether algorithms for sampling correctors can be more efficient in terms of sample complexity than learning algorithms for the analogous families of distributions. When correcting monotonicity, we show that this is indeed the case when also granted query access to the cumulative distribution function. We also obtain sampling correctors for monotonicity even without this stronger type of access, provided that the distribution be originally very close to monotone (namely, at a distance $O(1/\log^2 n)$). In addition to that, we consider a restricted error model that aims at capturing missing data corruptions. In this model, we show that distributions that are close to monotone have sampling correctors that are significantly more efficient than achievable by the learning approach. We consider the question of whether an additional source of independent random bits is required by sampling correctors to implement the correction process. We show that for correcting close-to-uniform distributions and close-to-monotone distributions, no additional source of random bits is required, as the samples from the input source itself can be used to produce this randomness.

Informed Correctors for Discrete Diffusion Models

Improved Convergence of Score-Based Diffusion Models via Prediction-Correction

DC-Solver: Improving Predictor-Corrector Diffusion Sampler via Dynamic Compensation

Sampling Correctors

Correcting Diffusion Generation through Resampling

How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework

Convergence Analysis of Discrete Diffusion Model: Exact Implementation through Uniformization

$\textit{Jump Your Steps}$: Optimizing Sampling Schedule of Discrete Diffusion Models

Accelerating Convergence of Score-Based Diffusion Models, Provably

Reverse Transition Kernel: A Flexible Framework to Accelerate Diffusion Inference

Diffusion models for Gaussian distributions: Exact solutions and Wasserstein errors

Convergence of Score-Based Discrete Diffusion Models: A Discrete-Time Analysis

Diffusion Sampling Correction via Approximately 10 Parameters

Improved Convergence Rate for Diffusion Probabilistic Models

Consistent Diffusion Meets Tweedie: Training Exact Ambient Diffusion Models with Noisy Data

Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models

A Geometric Perspective on Diffusion Models

Subsampling Error in Stochastic Gradient Langevin Diffusions

Think Twice Before You Act: Improving Inverse Problem Solving With MCMC

Tweedie Moment Projected Diffusions For Inverse Problems

Contractive Diffusion Probabilistic Models