Abstract:SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1078-1117, June 2024. This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed proximal-point iteration that admits two complementary interpretations. For models that are smooth or regularized by Moreau–Yosida smoothing, the algorithm is equivalent to an implicit midpoint discretization of an overdamped Langevin diffusion targeting the posterior distribution of interest. This discretization is asymptotically unbiased for Gaussian targets and shown to converge in an accelerated manner for any target that is [math]-strongly log-concave (i.e., requiring in the order of [math] iterations to converge, similar to accelerated optimization schemes), comparing favorably to Pereyra, Vargas Mieles, and Zygalakis [SIAM J. Imaging Sci., 13 (2020), pp. 905–935], which is only provably accelerated for Gaussian targets and has bias. For models that are not smooth, the algorithm is equivalent to a Leimkuhler–Matthews discretization of a Langevin diffusion targeting a Moreau–Yosida approximation of the posterior distribution of interest and hence achieves a significantly lower bias than conventional unadjusted Langevin strategies based on the Euler–Maruyama discretization. For targets that are [math]-strongly log-concave, the provided nonasymptotic convergence analysis also identifies the optimal time step, which maximizes the convergence speed. The proposed methodology is demonstrated through a range of experiments related to image deconvolution with Gaussian and Poisson noise with assumption-driven and data-driven convex priors. Source codes for the numerical experiments of this paper are available from https://github.com/MI2G/accelerated-langevin-imla.

Empirical Bayesian Imaging With Large-Scale Push-Forward Generative Priors

MBD-GAN: Model-based Image Deblurring with a Generative Adversarial Network.

A Hierarchical Variational Bayesian Approximation Approach in Acoustic Imaging

An Efficient Variational Bayesian Inference Approach Via Studient's-t Priors for Acoustic Imaging in Colored Noises

A Variational Bayesian Approximation Approach Via A Sparsity Enforcing Prior In Acoustic Imaging

Multi-frame Image Super Resolution with Natural Image Prior

Variational Bayesian Imaging with an Efficient Surrogate Score-based Prior

Accelerated Bayesian Imaging by Relaxed Proximal-Point Langevin Sampling

Bayesian imaging inverse problem with SA-Roundtrip prior via HMC-pCN sampler

Efficient Bayesian Computation by Proximal Markov Chain Monte Carlo: When Langevin Meets Moreau

Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors

Provable Probabilistic Imaging Using Score-Based Generative Priors

Bayesian computation with generative diffusion models by Multilevel Monte Carlo

Linear Inverse Problems Using a Generative Compound Gaussian Prior

Tackling the Problem of Distributional Shifts: Correcting Misspecified, High-Dimensional Data-Driven Priors for Inverse Problems

Do Bayesian imaging methods report trustworthy probabilities?

Scalable Bayesian Inference in the Era of Deep Learning: From Gaussian Processes to Deep Neural Networks

Bayesian MRI reconstruction with joint uncertainty estimation using diffusion models

Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imaging.

Score-Based Diffusion Models as Principled Priors for Inverse Imaging