Abstract:Score-based stochastic denoising models have recently been demonstrated as powerful machine learning tools for conditional and unconditional image generation. The existing methods are based on a forward stochastic process wherein the training images are scaled to zero over time and white noise is gradually added such that the final time step is approximately zero-mean identity-covariance Gaussian noise. A neural network is then trained to approximate the time-dependent score function, or the gradient of the logarithm of the probability density, for that time step. Using this score estimator, it is possible to run an approximation of the time-reversed stochastic process to sample new images from the training data distribution. These score-based generative models have been shown to out-perform generative adversarial neural networks using standard benchmarks and metrics. However, one issue with this approach is that it requires a large number of forward passes of the neural network. Additionally, the images at intermediate time steps are not useful, since the signal-to-noise ratio is low. In this work we present a new method called Fourier Diffusion Models which replaces the scalar operations of the forward process with shift-invariant convolutions and the additive white noise with additive stationary noise. This allows for control of MTF and NPS at intermediate time steps. Additionally, the forward process can be crafted to converge to the same MTF and NPS as the measured images. This way, we can model continuous probability flow from true images to measurements. In this way, the sample time can be used to control the tradeoffs between measurement uncertainty and generative uncertainty of posterior estimates. We compare Fourier diffusion models to existing scalar diffusion models and show that they achieve a higher level of performance and allow for a smaller number of time steps.

Frequency-Time Diffusion with Neural Cellular Automata

An Organism Starts with a Single Pix-Cell: A Neural Cellular Diffusion for High-Resolution Image Synthesis

Flexiffusion: Segment-wise Neural Architecture Search for Flexible Denoising Schedule

Spatial-Frequency U-Net for Denoising Diffusion Probabilistic Models

Diffusion Models Without Attention

Non-Uniform Diffusion Models

The Uncanny Valley: A Comprehensive Analysis of Diffusion Models

Denoising Diffusion Step-aware Models

Image Neural Field Diffusion Models

FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Models

NoiseNCA: Noisy Seed Improves Spatio-Temporal Continuity of Neural Cellular Automata

Neural Diffusion Models

Fast Inference in Denoising Diffusion Models via MMD Finetuning

Image Denoising Via Multiscale Nonlinear Diffusion Models.

simple diffusion: End-to-end diffusion for high resolution images

Factorized Diffusion Architectures for Unsupervised Image Generation and Segmentation

Matryoshka Diffusion Models

Fourier Diffusion Models: A Method to Control MTF and NPS in Score-Based Stochastic Image Generation

Stable Diffusion with Continuous-time Neural Network

SinDDM: A Single Image Denoising Diffusion Model

DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Models