Abstract:Scribble colors based line art colorization is a challenging computer vision problem since neither greyscale values nor semantic information is presented in line arts, and the lack of authentic illustration-line art training pairs also increases difficulty of model generalization. Recently, several Generative Adversarial Nets (GANs) based methods have achieved great success. They can generate colorized illustrations conditioned on given line art and color hints. However, these methods fail to capture the authentic illustration distributions and are hence perceptually unsatisfying in the sense that they often lack accurate shading. To address these challenges, we propose a novel deep conditional adversarial architecture for scribble based anime line art colorization. Specifically, we integrate the conditional framework with WGAN-GP criteria as well as the perceptual loss to enable us to robustly train a deep network that makes the synthesized images more natural and real. We also introduce a local features network that is independent of synthetic data. With GANs conditioned on features from such network, we notably increase the generalization capability over "in the wild" line arts. Furthermore, we collect two datasets that provide high-quality colorful illustrations and authentic line arts for training and benchmarking. With the proposed model trained on our illustration dataset, we demonstrate that images synthesized by the presented approach are considerably more realistic and precise than alternative approaches.

Automatic Coloring Method for Ethnic Costume Sketch Based on Pix2Pix Network

Fine‐grained semantic ethnic costume high‐resolution image colorization with conditional GAN

CTH-Net: CNN-Transformer Hybrid Network for Garment Image Generation from Sketches and Color Points

Creative and Diverse Artwork Generation Using Adversarial Networks

Automatic Coloring of Anime Line Art Based on Improved CycleGAN

A Comparative Study of Image-to-Image Translation Using GANs for Synthetic Child Race Data

Adversarial Interactive Cartoon Sketch Colourization with Texture Constraint and Auxiliary Auto-Encoder.

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

CoPaint: Guiding Sketch Painting with Consistent Color and Coherent Generative Adversarial Networks

Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN

User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks.

Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Wasserstein Generative Adversarial Networks

Colorization Using Neural Network Ensemble.

Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss

Automatic colorization for Thangka sketch-based paintings

Color Face Image Generation with Improved Generative Adversarial Networks

Towards Vivid and Diverse Image Colorization with Generative Color Prior

Automatic Colorization of Anime Style Illustrations Using a Two-Stage Generator

Double-Channel Guided Generative Adversarial Network for Image Colorization

ColorGAN: Automatic Image Colorization with GAN

Color Matching Generation Algorithm for Animation Characters Based on Convolutional Neural Network