Abstract:Given a photo of a subject, ability to generate a caricature image that captures distinct characteristics of the subject but with certain exaggeration of their prominent features is of fundamental importance to image processing and facial recognition. There are two main challenges in this task: shape exaggeration and style transfer. The former morphs and exaggerates key facial features of the subject, while the latter generates caricature images in a certain artistic style. In this paper, we propose a CAricature Style Transfer (CAST) framework for caricature generation. There are two modules in the proposed framework. The first is a geometric warping module. Different from the existing style transfer methods, we incorporate the Whitening and Coloring Transformation (WCT) in the geometric style transfer. The WCT is learned on photo and caricature landmarks or the caricature landmark space of a specific artist and is capable of transforming input photo landmarks to caricature landmarks. The second module is a texture style rendering module. We propose a new style transfer method by considering a semantic region-aligned style transfer via affinity constraint. Given a reference caricature image as the style reference, this module is capable of transferring styles between the same or similar semantic regions in caricatures and photos. Furthermore, it can transfer visual attributes of the reference caricatures (such as mouth shape and expressions) to the output caricatures. Experiments have shown desirable effects of the proposed method in transferring both the geometric and artistic texture styles of caricatures. Both qualitative and quantitative results show that the CAST framework is more effective compared than the state-of-the-art caricature generation methods.

Free editing of Shape and Texture with Deformable Net for 3D Caricature Generation

Modeling Caricature Expressions by 3D Blendshape and Dynamic Texture

Double Reference Guided Interactive 2D and 3D Caricature Generation

Learning to Caricature Via Semantic Shape Transform

3D-Carigan: an End-to-End Solution to 3D Caricature Generation from Normal Face Photos

CaricatureShop: Personalized and Photorealistic Caricature Sketching

Controllable Facial Caricaturization with Localized Deformation and Personalized Semantic Attentions

3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Face Photos

Synthesis, Style Editing, and Animation of 3D Cartoon Face

CAST: Learning Both Geometric and Texture Style Transfers for Effective Caricature Generation

“Edutainment 2017” a Visual and Semantic Representation of 3D Face Model for Reshaping Face in Images

AutoToon: Automatic Geometric Warping for Face Cartoon Generation

Exaggerated Portrait Caricatures Synthesis

MaTe3D: Mask-guided Text-based 3D-aware Portrait Editing

Learning to Infer Semantic Parameters for 3D Shape Editing

New Fashion: Personalized 3D Design with a Single Sketch Input

Animating Cartoon Faces by Multi-View Drawings

Sample Based Face Caricature Generation

CariMe: Unpaired Caricature Generation with Multiple Exaggerations

Example-based caricature generation with exaggeration

Performance-Driven Animation of Hand-Drawn Cartoon Faces