Abstract:Automatic sketch colorization is a challenging task in both computer graphics and computer vision since all the color, texture, shading generation have to be created based on the abstract sketch. Besides, it is a subjective task in painting process, which needs illustrators to comprehend drawing priori (DP), such as hue variation, saturation contrast and gray contrast and utilize them in the HSV color space which is closer to human visual cognition system. As such, incorporating supplementary supervision in the HSV color space may be beneficial to sketch colorization. However, previous methods improve the colorization quality only in the RGB color space without considering the HSV color space, often causing results with dull color, inappropriate saturation contrast, and artifacts. To address this issue, we propose a novel sketch colorization method, dual color space guided generative adversarial network (DCSGAN), that considers the complementary information contained in both the RGB and HSV color space. Specifically, we incorporate the HSV color space to construct dual color spaces for supervising our method with a color space transformation (CST) network that learns transformation from the RGB to HSV color space. Then, we propose a DP loss that enables the DCSGAN to generate vivid color images with pixel level supervision. Additionally, a novel dual color space adversarial (DCSA) loss is designed to guide the generator at global level to reduce the artifacts to meet audiences' aesthetic expectations. Extensive experiments and ablation studies demonstrate the superiority of the proposed method over previous state-of-the-art (SOTA) methods.

Automatic Sketch Colorization with Tandem Conditional Adversarial Networks.

Creative and Diverse Artwork Generation Using Adversarial Networks

Painting Style-Aware Manga Colorization Based on Generative Adversarial Networks

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

PencilArt: A Chromatic Penciling Style Generation Framework.

SmartPaint: a Co-Creative Drawing System Based on Generative Adversarial Networks

Dual Color Space Guided Sketch Colorization

Automatic Coloring of Anime Line Art Based on Improved CycleGAN

Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN

Outline Colorization through Tandem Adversarial Networks

cGAN-based Manga Colorization Using a Single Training Image

GAN-based AI Drawing Board for Image Generation and Colorization

Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorization

Staged Sketch-to-Image Synthesis via Semi-supervised Generative Adversarial Networks

Double-Channel Guided Generative Adversarial Network for Image Colorization

Conditional GANs for painting generation

SketchGAN: Joint Sketch Completion and Recognition with Generative Adversarial Network.

Automatic Colorization of Anime Style Illustrations Using a Two-Stage Generator

SPDGAN: A Generative Adversarial Network based on SPD Manifold Learning for Automatic Image Colorization

GGD-GAN: Gradient-Guided Dual-Branch Adversarial Networks for Relic Sketch Generation

Color Hint-guided Ink Wash Painting Colorization with Ink Style Prediction Mechanism