Abstract:Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many efforts have been dedicated to this task, it remains particularly challenging to generate believable, natural scenes. To facilitate the real-world applications of text-to-image synthesis, we focus on studying the following three issues: 1) How to ensure that generated samples are believable, realistic or natural? 2) How to exploit the latent space of the generator to edit a synthesized image? 3) How to improve the explainability of a text-to-image generation framework? In this work, we constructed two novel data sets (i.e., the Good & Bad bird and face data sets) consisting of successful as well as unsuccessful generated samples, according to strict criteria. To effectively and efficiently acquire high-quality images by increasing the probability of generating Good latent codes, we use a dedicated Good/Bad classifier for generated images. It is based on a pre-trained front end and fine-tuned on the basis of the proposed Good & Bad data set. After that, we present a novel algorithm which identifies semantically-understandable directions in the latent space of a conditional text-to-image GAN architecture by performing independent component analysis on the pre-trained weight values of the generator. Furthermore, we develop a background-flattening loss (BFL), to improve the background appearance in the edited image. Subsequently, we introduce linear interpolation analysis between pairs of keywords. This is extended into a similar triangular `linguistic' interpolation in order to take a deep look into what a text-to-image synthesis model has learned within the linguistic embeddings. Our data set is available at <a class="link-external link-https" href="https://zenodo.org/record/6283798#.YhkN_ujMI2w" rel="external noopener nofollow">this https URL</a>.

Face Generation from Textual Features using Conditionally Trained Inputs to Generative Adversarial Networks

Text2FaceGAN: Face Generation from Fine Grained Textual Descriptions

Exploring Generative Adversarial Networks for Face Generation

Semantic Text-to-Face GAN -ST^2FG

Face Image Inpainting Based on Generative Adversarial Network

Optimal text-to-image synthesis model for generating portrait images using generative adversarial network techniques

Text-to-Face Generation with StyleGAN2

Learning to Draw Text in Natural Images with Conditional Adversarial Networks

Towards photorealistic face generation using text-guided Semantic-Spatial FaceGAN

Facial Attribute Editing Using Generative Adversarial Network

Face image generation and feature visualization using deep convolutional generative adversarial networks

Face Synthesis from Visual Attributes via Sketch using Conditional VAEs and GANs

From Inference to Generation: End-to-end Fully Self-supervised Generation of Human Face from Speech

Generate Identity-Preserving Faces by Generative Adversarial Networks.

Evading Forensic Classifiers with Attribute-Conditioned Adversarial Faces

DualG-GAN, a Dual-channel Generator based Generative Adversarial Network for text-to-face synthesis

Face aging with conditional generative adversarial networks

Text to Image Synthesis using Generative Adversarial Networks

Generative Adversarial Network for Text-to-Face Synthesis and Manipulation

OptGAN: Optimizing and Interpreting the Latent Space of the Conditional Text-to-Image GANs

Prediction of face age progression with generative adversarial networks