Abstract:Given a photo of a subject, ability to generate a caricature image that captures distinct characteristics of the subject but with certain exaggeration of their prominent features is of fundamental importance to image processing and facial recognition. There are two main challenges in this task: shape exaggeration and style transfer. The former morphs and exaggerates key facial features of the subject, while the latter generates caricature images in a certain artistic style. In this paper, we propose a CAricature Style Transfer (CAST) framework for caricature generation. There are two modules in the proposed framework. The first is a geometric warping module. Different from the existing style transfer methods, we incorporate the Whitening and Coloring Transformation (WCT) in the geometric style transfer. The WCT is learned on photo and caricature landmarks or the caricature landmark space of a specific artist and is capable of transforming input photo landmarks to caricature landmarks. The second module is a texture style rendering module. We propose a new style transfer method by considering a semantic region-aligned style transfer via affinity constraint. Given a reference caricature image as the style reference, this module is capable of transferring styles between the same or similar semantic regions in caricatures and photos. Furthermore, it can transfer visual attributes of the reference caricatures (such as mouth shape and expressions) to the output caricatures. Experiments have shown desirable effects of the proposed method in transferring both the geometric and artistic texture styles of caricatures. Both qualitative and quantitative results show that the CAST framework is more effective compared than the state-of-the-art caricature generation methods.

Variation Robust Cross-Modal Metric Learning for Caricature Recognition

A Joint Local and Global Deep Metric Learning Method for Caricature Recognition

Caricature-visual face recognition based on jigsaw solving and modal decoupling

CariMe: Unpaired Caricature Generation with Multiple Exaggerations

Unsupervised Domain Attention Adaptation Network for Caricature Attribute Recognition

Retrieval Based Cartoon Synthesis Via Heterogeneous Features Learning

WebCaricature: a Benchmark for Caricature Recognition.

A Relation Network Embedded with Prior Features for Few-Shot Caricature Recognition

Mapping learning in eigenspace for harmonious caricature generation.

Weakly-supervised caricature face parsing through domain adaptation

Ensemble of Sparse Cross-Modal Metrics for Heterogeneous Face Recognition.

Cross Task Modality Alignment Network for Sketch Face Recognition

Heterogeneous Face Recognition by Margin-Based Cross-Modality Metric Learning.

CariGAN: Caricature generation through weakly paired adversarial learning

Learning to Caricature Via Semantic Shape Transform

CAST: Learning Both Geometric and Texture Style Transfers for Effective Caricature Generation

High-Quality Face Caricature via Style Translation

3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Face Photos

Local Large-Margin Multi-Metric Learning for Face and Kinship Verification

MW-GAN: Multi-Warping GAN for Caricature Generation With Multi-Style Geometric Exaggeration

Semi-supervised Learning of Caricature Pattern from Manifold Regularization