Abstract:In this paper, we propose a solution to transforming photos of real-world scenes into cartoon style images, which is valuable and challenging in computer vision and computer graphics. Our solution belongs to learning based methods, which have recently become popular to stylize images in artistic forms such as painting. However, existing methods do not produce satisfactory results for cartoonization, due to the fact that (1) cartoon styles have unique characteristics with high level simplification and abstraction, and (2) cartoon images tend to have clear edges, smooth color shading and relatively simple textures, which exhibit significant challenges for texture-descriptor-based loss functions used in existing methods. In this paper, we propose CartoonGAN, a generative adversarial network (GAN) framework for cartoon stylization. Our method takes unpaired photos and cartoon images for training, which is easy to use. Two novel losses suitable for cartoonization are proposed: (1) a semantic content loss, which is formulated as a sparse regularization in the high-level feature maps of the VGG network to cope with substantial style variation between photos and cartoons, and (2) an edge-promoting adversarial loss for preserving clear edges. We further introduce an initialization phase, to improve the convergence of the network to the target manifold. Our method is also much more efficient to train than existing methods. Experimental results show that our method is able to generate high-quality cartoon images from real-world photos (i.e., following specific artists' styles and with clear edges and smooth shading) and outperforms state-of-the-art methods.

Tone-Preserving Colorization of Black-and-White Cartoon Image

An Automatic Image and Video Colorization Algorithm Based on Pattern Continuity

Hand-drawn Grayscale Image Colorful Colorization Based on Natural Image

Caster: Cartoon Style Transfer Via Dynamic Cartoon Style Casting

Style Conversion of Cartoon Animation

Feature-preserving color pencil drawings from photographs

Active Colorization for Cartoon Line Drawings

Structure-Preserving Colorization Based on Quaternionic Phase Reconstruction

Adversarial Interactive Cartoon Sketch Colourization with Texture Constraint and Auxiliary Auto-Encoder.

Real-time Contrast Preserving Decolorization

Contour-Preserved Retargeting of Cartoon Images

Real-Color Image Denoised and Enhanced Synchronously Based on Wavelet Transform

Comicolorization: Semi-Automatic Manga Colorization

Video Tonal Stabilization Via Color States Smoothing.

CartoonGAN: Generative Adversarial Networks for Photo Cartoonization.

Patch-driven colorization

An adaptive cartoon-like stylization for color video in real time

Fast Multi-Resolution Colorization of High-Resolution Gray Images

Affective Image Colorization

Two Decades of Colorization and Decolorization for Images and Videos

An Extended Method for Reversible Color Tone Control Using Data Hiding