Abstract:Cartoon is a common form of art in our daily life and automatic generation of cartoon images from photos is highly desirable. However, state-of-the-art single-style methods can only generate one style of cartoon images from photos and existing multi-style image style transfer methods still struggle to produce high-quality cartoon images due to their highly simplified and abstract nature. In this article, we propose a novel multi-style generative adversarial network (GAN) architecture, called MS-CartoonGAN, which can transform photos into multiple cartoon styles. MS-CartoonGAN uses only unpaired photos and cartoon images of multiple styles for training. To achieve this, we propose to use (1) a hierarchical semantic loss with sparse regularization to retain semantic content and recover flat shading in different abstract levels, (2) a new edge-promoting adversarial loss for producing fine edges, and (3) a style loss to enhance the difference between output cartoon styles and make training process more stable. We also develop a multi-domain architecture, where the generator consists of a shared encoder and multiple decoders for different cartoon styles, along with multiple discriminators for individual styles. By observing that cartoon images drawn by different artists have their unique styles while sharing some common characteristics, our shared network architecture exploits the common characteristics of cartoon styles, achieving better cartoonization and being more efficient than single-style cartoonization. We show that our multi-domain architecture can theoretically guarantee to output desired multiple cartoon styles. Through extensive experiments including a user study, we demonstrate the superiority of the proposed method, outperforming state-of-the-art single-style and multi-style image style transfer methods.

Multi-Style Artistic Portrait Drawing Generation

Feature-Based Automatic Portrait Generation System

Unpaired Portrait Drawing Generation Via Asymmetric Cycle Mapping.

Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data

Generating Artistic Portraits from Face Photos with Feature Disentanglement and Reconstruction

Apdrawinggan: Generating Artistic Portrait Drawings From Face Photos With Hierarchical Gans

Learning to Sketch Human Facial Portraits Using Personal Styles by Case-Based Reasoning

DualStyle3D: Real-time Exemplar-based Artistic Portrait View Synthesis Based on Radiance Field

DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGAN

Multi-Style Facial Sketch Synthesis through Masked Generative Modeling

Face photo-sketch portraits transformation via generation pipeline

Animating Portrait Line Drawings from a Single Face Photo and a Speech Signal

PS-StyleGAN: Illustrative Portrait Sketching using Attention-Based Style Adaptation

Few-shots Portrait Generation with Style Enhancement and Identity Preservation

CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learning

GAN-based Multi-Style Photo Cartoonization

Line Drawings for Face Portraits from Photos Using Global and Local Structure Based GANs

Generating Animatable 3D Cartoon Faces from Single Portraits

Multi-Modal Face Stylization with a Generative Prior

AgileGAN3D: Few-Shot 3D Portrait Stylization by Augmented Transfer Learning

Cartoon Your Life