Abstract:Score-based stochastic denoising models have recently been demonstrated as powerful machine learning tools for conditional and unconditional image generation. The existing methods are based on a forward stochastic process wherein the training images are scaled to zero over time and white noise is gradually added such that the final time step is approximately zero-mean identity-covariance Gaussian noise. A neural network is then trained to approximate the time-dependent score function, or the gradient of the logarithm of the probability density, for that time step. Using this score estimator, it is possible to run an approximation of the time-reversed stochastic process to sample new images from the training data distribution. These score-based generative models have been shown to out-perform generative adversarial neural networks using standard benchmarks and metrics. However, one issue with this approach is that it requires a large number of forward passes of the neural network. Additionally, the images at intermediate time steps are not useful, since the signal-to-noise ratio is low. In this work we present a new method called Fourier Diffusion Models which replaces the scalar operations of the forward process with shift-invariant convolutions and the additive white noise with additive stationary noise. This allows for control of MTF and NPS at intermediate time steps. Additionally, the forward process can be crafted to converge to the same MTF and NPS as the measured images. This way, we can model continuous probability flow from true images to measurements. In this way, the sample time can be used to control the tradeoffs between measurement uncertainty and generative uncertainty of posterior estimates. We compare Fourier diffusion models to existing scalar diffusion models and show that they achieve a higher level of performance and allow for a smaller number of time steps.

Score-based Diffusion Models for Bayesian Image Reconstruction

Score-Based Diffusion Models as Principled Priors for Inverse Imaging

Conditional score-based diffusion models for solving inverse problems in mechanics

Score-Based Diffusion Models for Photoacoustic Tomography Image Reconstruction

Bayesian Conditioned Diffusion Models for Inverse Problems

Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data

Provably Robust Score-Based Diffusion Posterior Sampling for Plug-and-Play Image Reconstruction

Multilevel Diffusion: Infinite Dimensional Score-Based Diffusion Models for Image Generation

What's the score? Automated Denoising Score Matching for Nonlinear Diffusions

Bayesian MRI reconstruction with joint uncertainty estimation using diffusion models

Diffusion Posterior Sampling for Nonlinear CT Reconstruction

CT Reconstruction using Diffusion Posterior Sampling conditioned on a Nonlinear Measurement Model

Fourier Diffusion Models: A Method to Control MTF and NPS in Score-Based Stochastic Image Generation

MRI Reconstruction with Side Information using Diffusion Models

Steerable Conditional Diffusion for Out-of-Distribution Adaptation in Medical Image Reconstruction

Score-based Denoising Diffusion with Non-Isotropic Gaussian Noise Models

Conditional score-based diffusion models for Bayesian inference in infinite dimensions

Score-Guided Diffusion for 3D Human Recovery

Diffusion posterior sampling for magnetic resonance imaging

Score-based Diffusion Models via Stochastic Differential Equations -- a Technical Tutorial

Denoising Diffusion Bridge Models