Abstract:Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly photorealistic images could be generated from a simple textual description of an image. Based on a novel approach for image generation called diffusion models, text-to-image models enable the production of many different types of high resolution images, where human imagination is the only limit. However, these models require exceptionally large amounts of computational resources to train, as well as handling huge datasets collected from the internet. In addition, neither the codebase nor the models have been released. It consequently prevents the AI community from experimenting with these cutting-edge models, making the reproduction of their results complicated, if not impossible. In this thesis, we aim to contribute by firstly reviewing the different approaches and techniques used by these models, and then by proposing our own implementation of a text-to-image model. Highly based on DALL-E 2, we introduce several slight modifications to tackle the high computational cost induced. We thus have the opportunity to experiment in order to understand what these models are capable of, especially in a low resource regime. In particular, we provide additional and analyses deeper than the ones performed by the authors of DALL-E 2, including ablation studies. Besides, diffusion models use so-called guidance methods to help the generating process. We introduce a new guidance method which can be used in conjunction with other guidance methods to improve image quality. Finally, the images generated by our model are of reasonably good quality, without having to sustain the significant training costs of state-of-the-art text-to-image models.

Understanding and contextualising diffusion models

State of the Art on Diffusion Models for Visual Computing

Tutorial on Diffusion Models for Imaging and Vision

Diffusion Models Generate Images Like Painters: an Analytical Theory of Outline First, Details Later

An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization

Explaining generative diffusion models via visual analysis for interpretable decision-making process

Implementing and Experimenting with Diffusion Models for Text-to-Image Generation

An overview of diffusion models for generative artificial intelligence

Differential Diffusion: Giving Each Pixel Its Strength

A Survey on Generative Diffusion Models

The Hidden Language of Diffusion Models

Nested Diffusion Processes for Anytime Image Generation

The Uncanny Valley: A Comprehensive Analysis of Diffusion Models

A Survey of Diffusion Based Image Generation Models: Issues and Their Solutions

Renormalization Group flow, Optimal Transport and Diffusion-based Generative Model

Text-to-image Diffusion Models in Generative AI: A Survey

Principles of Diffusion Models and Their Applications on Medicine

Diffusion idea exploration for art generation

Diffusion Explainer: Visual Explanation for Text-to-image Stable Diffusion

Diffusion Models in Vision: A Survey

Generative AI in Vision: A Survey on Models, Metrics and Applications