Abstract:Denoising diffusion models represent a recent emerging topic in computer vision, demonstrating remarkable results in the area of generative modeling. A diffusion model is a deep generative model that is based on two stages, a forward diffusion stage and a reverse diffusion stage. In the forward diffusion stage, the input data is gradually perturbed over several steps by adding Gaussian noise. In the reverse stage, a model is tasked at recovering the original input data by learning to gradually reverse the diffusion process, step by step. Diffusion models are widely appreciated for the quality and diversity of the generated samples, despite their known computational burdens, i.e. low speeds due to the high number of steps involved during sampling. In this survey, we provide a comprehensive review of articles on denoising diffusion models applied in vision, comprising both theoretical and practical contributions in the field. First, we identify and present three generic diffusion modeling frameworks, which are based on denoising diffusion probabilistic models, noise conditioned score networks, and stochastic differential equations. We further discuss the relations between diffusion models and other deep generative models, including variational auto-encoders, generative adversarial networks, energy-based models, autoregressive models and normalizing flows. Then, we introduce a multi-perspective categorization of diffusion models applied in computer vision. Finally, we illustrate the current limitations of diffusion models and envision some interesting directions for future research.

From Denoising Diffusions to Denoising Markov Models

Denoising Diffusion Samplers

To smooth a cloud or to pin it down: Guarantees and Insights on Score Matching in Denoising Diffusion Models

Diffusion Model for Generative Image Denoising

Score-based Denoising Diffusion with Non-Isotropic Gaussian Noise Models

Denoising Diffusion Bridge Models

What's the score? Automated Denoising Score Matching for Nonlinear Diffusions

Particle Denoising Diffusion Sampler

Statistical guarantees for denoising reflected diffusion models

Diffusion Models for Graphs Benefit From Discrete State Spaces

An overview of diffusion models for generative artificial intelligence

Listening to the Noise: Blind Denoising with Gibbs Diffusion

Interpreting and Improving Diffusion Models from an Optimization Perspective

Evaluating the design space of diffusion-based generative models

Deep Networks as Denoising Algorithms: Sample-Efficient Learning of Diffusion Models in High-Dimensional Graphical Models

Diffusion Models in Vision: A Survey

A Note on the Convergence of Denoising Diffusion Probabilistic Models

Non-Uniform Diffusion Models