Abstract:The architecture is based on multiple decomposition of GAN model. This network model learns the decomposition of the generated image features, texture representation is used to extract the high frequency texture features of the generated image to make it conform to the unique characteristics of the cartoon image and is guided by the discriminator to further enhance the cartoon texture of the generated image. The structure‐content representation makes the generated image have sparse color blocks and clear edges by mimicking the global content of the cartoon image, and maintains the structure and content of the original image with the pre‐trained network. Background Cartoon images play a vital role in film production, scientific and educational animation, video games, and other fields, and are one of the key visual expressions of artistic creation. However, since hand‐crafted cartoon images often require a great deal of time and effort on the part of professional artists, it is necessary to be able to automatically transform real‐world images into different styles of cartoon images. Although cartoon images vary from artist to artist, cartoon images generally have the unique characteristics of being highly simplified and abstract, with clear edges, smooth color shading, and relatively simple textures. However, existing image cartoonization methods tend to create a number of problems when performing style transfer, which mainly include: (1) the resulting generated images do not have obvious cartoon‐style textures; and (2) the generated images are prone to structural confusion, color artifacts, and loss of the original image content. Therefore, it is also a great challenge in the field of image cartoonization to be able to make a good balance between style transfer and content keeping. Methods In this paper, we propose a GAN‐based multi‐attention mechanism for image cartoonization to address the above issues. The method combines the residual block used to extract deep network features in the generator with the attention mechanism, and further strengthens the perceptual ability of the generative model to cartoon images through the adaptive feature correction of the attention module to improve the cartoon features of the generated images. At the same time, we also introduce the attention mechanism in the convolution block of the discriminator, which is used to further reduce the image visual quality problem caused by the style transfer process. By introducing the attention mechanism into the generator and discriminator models of the generative adversarial network, our method enables the generated images to have obvious cartoon‐style features while effectively improving the image's visual quality. Results A large number of quantitative, qualitative, and ablation experiments are conducted to demonstrate the advantages of our method in the field of image cartoonization and the role of each module in the method.

Lightweight Dynamic Conditional GAN with Pyramid Attention for Text-to-image Synthesis

Expression Conditional Gan for Facial Expression-to-Expression Translation.

Perceptual Pyramid Adversarial Networks for Text-to-Image Synthesis.

Statistics Enhancement Generative Adversarial Networks for Diverse Conditional Image Synthesis

Attack Deterministic Conditional Image Generative Models for Diverse and Controllable Generation

Synthesizing Contrast-enhanced Computed Tomography Images with an Improved Conditional Generative Adversarial Network

Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis.

DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesis

Customizable GAN: Customizable Image Synthesis Based on Adversarial Learning.

R-GAN: Exploring Human-like Way for Reasonable Text-to-Image Synthesis via Generative Adversarial Networks

DGattGAN: Cooperative Up-Sampling Based Dual Generator Attentional GAN on Text-to-Image Synthesis

SAM-GAN: Self-Attention supporting Multi-stage Generative Adversarial Networks for text-to-image synthesis

Multimodal Conditional Image Synthesis with Product-of-Experts GANs

Learning to Draw Text in Natural Images with Conditional Adversarial Networks

aRTIC GAN: A Recursive Text-Image-Conditioned GAN

Realistic Image Generation using Region-phrase Attention

CT-GAN: A conditional Generative Adversarial Network of transformer architecture for text-to-image

DTGAN: Dual Attention Generative Adversarial Networks for Text-to-Image Generation

DMF-GAN: Deep Multimodal Fusion Generative Adversarial Networks for Text-to-Image Synthesis

GAN‐Based Multi‐Decomposition Photo Cartoonization

DF-GAN: Deep Fusion Generative Adversarial Networks for Text-to-Image Synthesis.