Abstract:Although the text-to-image model aims to generate realistic images that correspond to the text description, generating high-quality, and accurate images remains a significant challenge. Most existing text-to-image methods are implemented through a two-stage stacking model, where the generation process is initiated by creating an initial image with a basic outline and subsequently refined to generate a high-resolution image. However, the quality of the initial image imposes limitations on this method as it directly impacts the final quality of the high-resolution output and may compromise the level of randomness in the high-resolution image, making it difficult for the model to generate a high-quality and realistic final image if the initial image is of low quality or lacks detail, causing the final image to lack diversity and to appear artificial if the initial image is too rigid or lacks randomness. Therefore, to overcome the limitation of the stacked structure, a new generative adversarial network method has been proposed, which generates high-resolution images directly from text descriptions, thus providing a more efficient and effective way to generate realistic images from text. Multi-head channel attention and masked cross-attention mechanisms are employed to emphasize the importance of relevance from various perspectives in order to enhance significant features associated with the text description and suppress non-essential features unrelated to the textual information. The integration of image and text information at a granular level is accomplished while employing a masked mechanism to minimize computational expenses and expedite the generation time of images. Furthermore, a discriminator-based semantic consistency loss function is devised to bolster the visual coherence between text and images, thereby directing the generator toward the production of more realistic images that align closely with text descriptions. The enhanced model improves the semantic consistency between text and images, leading to higher-quality generated images. Extensive experiments confirm the superiority of our proposed model to ControlGAN. On the CUB dataset, the model achieves an increased IS score from 4.58 to 4.96, while on the COCO dataset, the IS score improves from 24.06 to 33.56. Code is available at https://github.com/Leeziying0307/Github.git.

Adaptive Forgetting, Drafting and Comprehensive Guiding: Text-to-Image Synthesis with Hierarchical Generative Adversarial Networks

Learn, Imagine and Create: Text-to-Image Generation from Prior Knowledge.

DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesis

Controllable Text-to-Image Generation with Enhanced Text Encoder and Edge-Preserving Embedding

DF-GAN: Deep Fusion Generative Adversarial Networks for Text-to-Image Synthesis.

CD-GAN: Commonsense-Driven Generative Adversarial Network with Hierarchical Refinement for Text-to-Image Synthesis

KT-GAN: Knowledge-Transfer Generative Adversarial Network for Text-to-Image Synthesis

Object-driven Text-to-Image Synthesis via Adversarial Training

Perceptual Pyramid Adversarial Networks for Text-to-Image Synthesis.

TEXT TO IMAGE SYNTHESIS WITH ERUDITE GENERATIVE ADVERSARIAL NETWORKS

SAM-GAN: Self-Attention supporting Multi-stage Generative Adversarial Networks for text-to-image synthesis

SS-GANs: Text-to-Image via Stage by Stage Generative Adversarial Networks

Customizable GAN: Customizable Image Synthesis Based on Adversarial Learning.

DE-GAN: Text-to-image Synthesis with Dual and Efficient Fusion Model

Text to Photo-Realistic Image Synthesis Via Chained Deep Recurrent Generative Adversarial Network.

DGattGAN: Cooperative Up-Sampling Based Dual Generator Attentional GAN on Text-to-Image Synthesis

Dualattn-GAN: Text to Image Synthesis with Dual Attentional Generative Adversarial Network.

Knowledge-Driven Generative Adversarial Network for Text-to-Image Synthesis

A Text-to-Image Generation Method Based on Multiattention Depth Residual Generation Adversarial Network

Masked cross-attention and multi-head channel attention guiding single-stage generative adversarial networks for text-to-image generation

Hybrid Attention Driven Text-To-Image Synthesis Via Generative Adversarial Networks