Abstract:Introduction: Caricature is an exaggerated pictorial representation of a person, which is widely used in entertainment and political media. Recently, GAN-based methods achieved automatic caricature generation through transferring caricature style and performing shape exaggeration simultaneously. However, the caricature synthesized by these methods cannot perfectly reflect the characteristics of the subject, whose shape exaggeration are not reasonable and requires facial landmarks of caricature. In addition, the existing methods always produce the bad cases in caricature style due to the simpleness of their style transfer method. Methods: In this paper, we propose a Style Attention based Global-local Aware GAN to apply the characteristics of a subject to generate personalized caricature. To integrate the facial characteristics of a subject, we introduce a landmark-based warp controller for personalized shape exaggeration, which employs the facial landmarks as control points to warp image according to its facial features, without requirement of the facial landmarks of caricature. To fuse the facial feature with caricature style appropriately, we introduce a style-attention module, which adopts an attention mechanism, instead of the simple Adaptive Instance Normalization (AdaIN) for style transfer. To reduce the bad cases and increase the quality of generated caricatures, we propose a multi-scale discriminator to both globally and locally discriminate the synthesized and real caricature, which improves the whole structure and realistic details of the synthesized caricature. Results: Experimental results on two publicly available datasets, the WebCaricature and the CaVINet datasets, validate the effectiveness of our proposed method and suggest that our proposed method achieves better performance than the existing methods. Discussion: The caricatures generated by the proposed method can not only preserve the identity of input photo but also the characteristic shape exaggeration for each person, which are highly close to the real caricatures drawn by real artists. It indicates that our method can be adopted in the real application.

CanvasPic: An Interactive Tool for Freely Generating Facial Images Based on Spatial Layout

FaceChain: A Playground for Identity-Preserving Portrait Generation

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

Two Birds with One Stone: Transforming and Generating Facial Images with Iterative GAN

RealtimeGen: an Intervenable AI Image Generation System for Commercial Digital Art Asset Creators

Two Birds with One Stone: Iteratively Learn Facial Attributes with GANs.

Customizable GAN: Customizable Image Synthesis Based on Adversarial Learning.

SofGAN: A Portrait Image Generator with Dynamic Styling

Do Inpainting Yourself: Generative Facial Inpainting Guided by Exemplars

AniPortraitGAN: Animatable 3D Portrait Generation from 2D Image Collections

Interactive Image Synthesis with Panoptic Layout Generation

GAN-based AI Drawing Board for Image Generation and Colorization

Apdrawinggan: Generating Artistic Portrait Drawings From Face Photos With Hierarchical Gans

Towards Realistic Face Photo-Sketch Synthesis via Composition-Aided GANs

Generating Artistic Portraits from Face Photos with Feature Disentanglement and Reconstruction

3DFaceShop: Explicitly Controllable 3D-Aware Portrait Generation

Interpreting the Latent Space of GANs for Semantic Face Editing

DE-GAN: Domain Embedded GAN for High Quality Face Image Inpainting

Style attention based global-local aware GAN for personalized facial caricature generation

A Free Viewpoint Portrait Generator with Dynamic Styling.

Warp-Guided GANs for Single-Photo Facial Animation