Abstract:SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1078-1117, June 2024. This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed proximal-point iteration that admits two complementary interpretations. For models that are smooth or regularized by Moreau–Yosida smoothing, the algorithm is equivalent to an implicit midpoint discretization of an overdamped Langevin diffusion targeting the posterior distribution of interest. This discretization is asymptotically unbiased for Gaussian targets and shown to converge in an accelerated manner for any target that is [math]-strongly log-concave (i.e., requiring in the order of [math] iterations to converge, similar to accelerated optimization schemes), comparing favorably to Pereyra, Vargas Mieles, and Zygalakis [SIAM J. Imaging Sci., 13 (2020), pp. 905–935], which is only provably accelerated for Gaussian targets and has bias. For models that are not smooth, the algorithm is equivalent to a Leimkuhler–Matthews discretization of a Langevin diffusion targeting a Moreau–Yosida approximation of the posterior distribution of interest and hence achieves a significantly lower bias than conventional unadjusted Langevin strategies based on the Euler–Maruyama discretization. For targets that are [math]-strongly log-concave, the provided nonasymptotic convergence analysis also identifies the optimal time step, which maximizes the convergence speed. The proposed methodology is demonstrated through a range of experiments related to image deconvolution with Gaussian and Poisson noise with assumption-driven and data-driven convex priors. Source codes for the numerical experiments of this paper are available from https://github.com/MI2G/accelerated-langevin-imla.

Plug-and-Play Posterior Sampling under Mismatched Measurement and Prior Models

Prior Mismatch and Adaptation in PnP-ADMM with a Nonconvex Convergence Analysis

Provable Convergence of Plug-and-Play Priors with MMSE denoisers

Generative Plug and Play: Posterior Sampling for Inverse Problems

Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction

Plug-and-Play Priors as a Score-Based Method

Single-Shot Plug-and-Play Methods for Inverse Problems

Constrained Plug-and-Play Priors for Image Restoration

Plug-and-Play Split Gibbs Sampler: Embedding Deep Generative Priors in Bayesian Inference

Provable Probabilistic Imaging using Score-Based Generative Priors

Evaluating the Posterior Sampling Ability of Plug&Play Diffusion Methods in Sparse-View CT

Posterior sampling via Langevin dynamics based on generative priors

Accelerated Bayesian Imaging by Relaxed Proximal-Point Langevin Sampling

Block Coordinate Plug-and-Play Methods for Blind Inverse Problems

Divide-and-Conquer Posterior Sampling for Denoising Diffusion Priors

Plug-and-Play Methods Provably Converge with Properly Trained Denoisers.

Convergent Bregman Plug-and-Play Image Restoration for Poisson Inverse Problems

Scalable Nonparametric Sampling from Multimodal Posteriors with the Posterior Bootstrap

Convergence of Nonconvex PnP-ADMM with MMSE Denoisers

Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems