Abstract:Text-to-image synthesis refers to computational methods which translate human written textual descriptions, in the form of keywords or sentences, into images with similar semantic meaning to the text. In earlier research, image synthesis relied mainly on word to image correlation analysis combined with supervised methods to find best alignment of the visual content matching to the text. Recent progress in deep learning (DL) has brought a new set of unsupervised deep learning methods, particularly deep generative models which are able to generate realistic visual images using suitably trained neural network models. In this paper, we review the most recent development in the text-to-image synthesis research domain. Our survey first introduces image synthesis and its challenges, and then reviews key concepts such as generative adversarial networks (GANs) and deep convolutional encoder-decoder neural networks (DCNN). After that, we propose a taxonomy to summarize GAN based text-to-image synthesis into four major categories: Semantic Enhancement GANs, Resolution Enhancement GANs, Diversity Enhancement GANS, and Motion Enhancement GANs. We elaborate the main objective of each group, and further review typical GAN architectures in each group. The taxonomy and the review outline the techniques and the evolution of different approaches, and eventually provide a clear roadmap to summarize the list of contemporaneous solutions that utilize GANs and DCNNs to generate enthralling results in categories such as human faces, birds, flowers, room interiors, object reconstruction from edge maps (games) etc. The survey will conclude with a comparison of the proposed solutions, challenges that remain unresolved, and future developments in the text-to-image synthesis domain.

Narrative-guided synthesis: Revolutionizing text-to-image translation based on Generative Adversarial Networks

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

A Survey and Taxonomy of Adversarial Neural Networks for Text-to-Image Synthesis

Investigation related to application of Generative Adversarial Networks in text-to-image synthesis

StoryCraft AI: Exploring Generative Approaches to Story Narration through AI

Bridge-GAN: Interpretable Representation Learning for Text-to-Image Synthesis.

A survey of generative adversarial networks and their application in text-to-image synthesis

Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications

A Comparative Study of Generative Adversarial Networks for Text-to-Image Synthesis

R-GAN: Exploring Human-likeWay for Reasonable Text-to-Image Synthesis Via Generative Adversarial Networks

R-GAN: Exploring Human-like Way for Reasonable Text-to-Image Synthesis via Generative Adversarial Networks

Text-to-Image Synthesis With Generative Models: Methods, Datasets, Performance Metrics, Challenges, and Future Direction

Image Synthesis with Adversarial Networks: a Comprehensive Survey and Case Studies

A Survey on Adversarial Image Synthesis

Efficient Neural Architecture for Text-to-Image Synthesis

Text-to-Text Generative Adversarial Networks

A Novel Approach to Artistic Textual Visualization via GAN

Generative View Synthesis: From Single-view Semantics to Novel-view Images

Optimal text-to-image synthesis model for generating portrait images using generative adversarial network techniques

Successive Image Generation from a Single Sentence

CreativeSynth: Creative Blending and Synthesis of Visual Arts based on Multimodal Diffusion