Abstract:In this paper, we propose a solution to transforming photos of real-world scenes into cartoon style images, which is valuable and challenging in computer vision and computer graphics. Our solution belongs to learning based methods, which have recently become popular to stylize images in artistic forms such as painting. However, existing methods do not produce satisfactory results for cartoonization, due to the fact that (1) cartoon styles have unique characteristics with high level simplification and abstraction, and (2) cartoon images tend to have clear edges, smooth color shading and relatively simple textures, which exhibit significant challenges for texture-descriptor-based loss functions used in existing methods. In this paper, we propose CartoonGAN, a generative adversarial network (GAN) framework for cartoon stylization. Our method takes unpaired photos and cartoon images for training, which is easy to use. Two novel losses suitable for cartoonization are proposed: (1) a semantic content loss, which is formulated as a sparse regularization in the high-level feature maps of the VGG network to cope with substantial style variation between photos and cartoons, and (2) an edge-promoting adversarial loss for preserving clear edges. We further introduce an initialization phase, to improve the convergence of the network to the target manifold. Our method is also much more efficient to train than existing methods. Experimental results show that our method is able to generate high-quality cartoon images from real-world photos (i.e., following specific artists' styles and with clear edges and smooth shading) and outperforms state-of-the-art methods.

toon2real: Translating Cartoon Images to Realistic Images

Unsupervised Image-to-Image Translation with Generative Adversarial Networks.

cGANs for Cartoon to Real-life Images

Generating Cartoon Images from Face Photos with Cycle-Consistent Adversarial Networks

CartoonGAN: Generative Adversarial Networks for Photo Cartoonization.

GC-GAN: Photo Cartoonization Using Guided Cartoon Generative Adversarial Network

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

A Conditional Generative Adversarial Network Model for Sketch-to-Image Translation

On Unsupervised Image-to-image translation and GAN stability

Text-to-Image-to-Text Translation using Cycle Consistent Adversarial Networks

XGAN: Unsupervised Image-to-Image Translation for Many-to-Many Mappings

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

An Extensive Study of Cycle-Consistent Generative Networks for Image-to-Image Translation

SCONE-GAN: Semantic Contrastive learning-based Generative Adversarial Network for an end-to-end image translation

Rethinking CycleGAN: Improving Quality of GANs for Unpaired Image-to-Image Translation

Realistic Image-to-Image Translation with Enhanced Texture

CartoonRenderer: an Instance-Based Multi-style Cartoon Image Translator.

CSGAN: Cyclic-Synthesized Generative Adversarial Networks for image-to-image transformation

Dual Generator Generative Adversarial Networks for Multi-Domain Image-to-Image Translation

One-Step Image Translation with Text-to-Image Models

Generative Adversarial Networks for photo to Hayao Miyazaki style cartoons