Abstract:Diffusion models have swiftly taken the lead in generative modeling, establishing unprecedented standards for producing high-quality, varied outputs. Unlike Generative Adversarial Networks (GANs)—once considered the gold standard in this realm—diffusion models bring several unique benefits to the table. They are renowned for generating outputs that more accurately reflect the complexity of real-world data, showcase a wider array of diversity, and are based on a training approach that is comparatively more straightforward and stable. This survey aims to offer an exhaustive overview of both the theoretical underpinnings and practical achievements of diffusion models. We explore and outline three core approaches to diffusion modeling: denoising diffusion probabilistic models, score-based generative models, and stochastic differential equations. Subsequently, we delineate the algorithmic enhancements of diffusion models across several pivotal areas. A notable aspect of this review is an in-depth analysis of leading generative models, examining how diffusion models relate to and evolve from previous generative methodologies, offering critical insights into their synergy. A comparative analysis of the merits and limitations of different generative models is a vital component of our discussion. Moreover, we highlight the applications of diffusion models across computer vision, multi-modal generation, and beyond, culminating in significant conclusions and suggesting promising avenues for future investigation.

Diffusion models in text generation: a survey

Diffusion Models for Non-autoregressive Text Generation: A Survey

Diffusion Models in NLP: A Survey

A Survey of Diffusion Models in Natural Language Processing

Text-to-image Diffusion Models in Generative AI: A Survey

Diffusion Models: A Comprehensive Survey of Methods and Applications

A Survey on Generative Diffusion Model

A Survey on Generative Diffusion Models

A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI

AR-Diffusion: Auto-Regressive Diffusion Model for Text Generation

A Survey of Diffusion Based Image Generation Models: Issues and Their Solutions

InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation

Controllable Generation with Text-to-Image Diffusion Models: A Survey

Artificial-Intelligence-Generated Content with Diffusion Models: A Literature Review

Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices

An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization

A Survey of Multimodal Controllable Diffusion Models

Diffusion-based Graph Generative Methods

A Reparameterized Discrete Diffusion Model for Text Generation

Self-conditioned Embedding Diffusion for Text Generation