Abstract:In a great number of tasks in science and engineering, the goal is to infer an unknown image from a small number of measurements collected from a known forward model describing certain sensing or imaging modality. Due to resource constraints, this task is often extremely ill-posed, which necessitates the adoption of expressive prior information to regularize the solution space. Score-based diffusion models, due to its impressive empirical success, have emerged as an appealing candidate of an expressive prior in image reconstruction. In order to accommodate diverse tasks at once, it is of great interest to develop efficient, consistent and robust algorithms that incorporate unconditional score functions of an image prior distribution in conjunction with flexible choices of forward models. This work develops an algorithmic framework for employing score-based diffusion models as an expressive data prior in general nonlinear inverse problems. Motivated by the plug-and-play framework in the imaging community, we introduce a diffusion plug-and-play method (DPnP) that alternatively calls two samplers, a proximal consistency sampler based solely on the likelihood function of the forward model, and a denoising diffusion sampler based solely on the score functions of the image prior. The key insight is that denoising under white Gaussian noise can be solved rigorously via both stochastic (i.e., DDPM-type) and deterministic (i.e., DDIM-type) samplers using the unconditional score functions. We establish both asymptotic and non-asymptotic performance guarantees of DPnP, and provide numerical experiments to illustrate its promise in solving both linear and nonlinear image reconstruction tasks. To the best of our knowledge, DPnP is the first provably-robust posterior sampling method for nonlinear inverse problems using unconditional diffusion priors.

Denoising Prior Driven Reconstruction of Microscopy Images with Poisson Statistics

Simultaneous Nonlocal Low-Rank and Deep Priors for Poisson Denoising

Fourier ptychographic reconstruction with denoising diffusion probabilistic models

Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation

Denoising diffusion models for high-resolution microscopy image restoration

Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction

Fast and Accurate Poisson Denoising with Trainable Nonlinear Diffusion

Plug-and-play Inertial Forward–backward Algorithm for Poisson Image Deconvolution

Microscopy image reconstruction with physics-informed denoising diffusion probabilistic model

A Novel Denoising Reconstruction Algorithm for Multi-Height Lensless Microscopy

A Poisson-Gaussian Denoising Dataset with Real Fluorescence Microscopy Images

Denoising of poisson-corrupted microscopic biopsy images using fourth-order partial differential equation with ant colony optimization

Poisson Image Denoising by Piecewise Principal Component Analysis and Its Application in Single-Particle X-ray Diffraction Imaging.

Image-Specific Prior Adaptation for Denoising

Adaptive denoising method for Fourier ptychographic microscopy

Principled Probabilistic Imaging using Diffusion Models as Plug-and-Play Priors

Plug-and-Play Image Restoration with Deep Denoiser Prior

Plug-and-Play Priors for Reconstruction-based Placental Image Registration

Multiframe Denoising of High-Speed Optical Coherence Tomography Data Using Interframe and Intraframe Priors

Denoising for Optical-Resolution Photoacoustic Microscopy Via a Score-Based Diffusion Generative Model

Adaptive Denoising Method Based on Iterative Process for Fourier Ptychographic Microscopy