Abstract:In this paper, we propose a solution to transforming photos of real-world scenes into cartoon style images, which is valuable and challenging in computer vision and computer graphics. Our solution belongs to learning based methods, which have recently become popular to stylize images in artistic forms such as painting. However, existing methods do not produce satisfactory results for cartoonization, due to the fact that (1) cartoon styles have unique characteristics with high level simplification and abstraction, and (2) cartoon images tend to have clear edges, smooth color shading and relatively simple textures, which exhibit significant challenges for texture-descriptor-based loss functions used in existing methods. In this paper, we propose CartoonGAN, a generative adversarial network (GAN) framework for cartoon stylization. Our method takes unpaired photos and cartoon images for training, which is easy to use. Two novel losses suitable for cartoonization are proposed: (1) a semantic content loss, which is formulated as a sparse regularization in the high-level feature maps of the VGG network to cope with substantial style variation between photos and cartoons, and (2) an edge-promoting adversarial loss for preserving clear edges. We further introduce an initialization phase, to improve the convergence of the network to the target manifold. Our method is also much more efficient to train than existing methods. Experimental results show that our method is able to generate high-quality cartoon images from real-world photos (i.e., following specific artists' styles and with clear edges and smooth shading) and outperforms state-of-the-art methods.

Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Wasserstein Generative Adversarial Networks

Creative and Diverse Artwork Generation Using Adversarial Networks

AI-Sketcher : A Deep Generative Model for Producing High-Quality Sketches.

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks.

Adversarial Interactive Cartoon Sketch Colourization with Texture Constraint and Auxiliary Auto-Encoder.

CoPaint: Guiding Sketch Painting with Consistent Color and Coherent Generative Adversarial Networks

Automatic Sketch Colorization with Tandem Conditional Adversarial Networks.

GAN-based AI Drawing Board for Image Generation and Colorization

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

Color Hint-guided Ink Wash Painting Colorization with Ink Style Prediction Mechanism

Automatic Color Sketch Generation Using Deep Style Transfer

Staged Sketch-to-Image Synthesis via Semi-supervised Generative Adversarial Networks

Image Generation from Sketch Constraint Using Contextual GAN

Content-Conditioned Generation of Stylized Free hand Sketches

High-Fidelity Face Sketch-To-Photo Synthesis Using Generative Adversarial Network

Sketch Based Image Retrieval with Conditional Generative Adversarial Network

Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN

A Conditional Generative Adversarial Network Model for Sketch-to-Image Translation

CartoonGAN: Generative Adversarial Networks for Photo Cartoonization.

Towards Criminal Sketching with Generative Adversarial Network