Abstract:Automatic sketch colorization is a challenging task in both computer graphics and computer vision since all the color, texture, shading generation have to be created based on the abstract sketch. Besides, it is a subjective task in painting process, which needs illustrators to comprehend drawing priori (DP), such as hue variation, saturation contrast and gray contrast and utilize them in the HSV color space which is closer to human visual cognition system. As such, incorporating supplementary supervision in the HSV color space may be beneficial to sketch colorization. However, previous methods improve the colorization quality only in the RGB color space without considering the HSV color space, often causing results with dull color, inappropriate saturation contrast, and artifacts. To address this issue, we propose a novel sketch colorization method, dual color space guided generative adversarial network (DCSGAN), that considers the complementary information contained in both the RGB and HSV color space. Specifically, we incorporate the HSV color space to construct dual color spaces for supervising our method with a color space transformation (CST) network that learns transformation from the RGB to HSV color space. Then, we propose a DP loss that enables the DCSGAN to generate vivid color images with pixel level supervision. Additionally, a novel dual color space adversarial (DCSA) loss is designed to guide the generator at global level to reduce the artifacts to meet audiences' aesthetic expectations. Extensive experiments and ablation studies demonstrate the superiority of the proposed method over previous state-of-the-art (SOTA) methods.

DHAN-WGAN: Adversarial Image Colorization Using Deep Hybrid Attention Aggregation Network

ColorGAN: Automatic Image Colorization with GAN

DC-GAN with Feature Attention for Single Image Dehazing

Double-Channel Guided Generative Adversarial Network for Image Colorization

SPDGAN: A Generative Adversarial Network based on SPD Manifold Learning for Automatic Image Colorization

Towards Vivid and Diverse Image Colorization with Generative Color Prior

DW-GAN: Toward High-Fidelity Color-Tones of GAN-Generated Images With Dynamic Weights

PalGAN: Image Colorization with Palette Generative Adversarial Networks.

Texture-aware Gray-Scale Image Colorization Using a Bistream Generative Adversarial Network with Multi Scale Attention Structure

Remote Sensing Image Colorization Based on Joint Stream Deep Convolutional Generative Adversarial Networks

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

Interactive Grayscale Image Colorization with Generative Adversarial Networks

Transforming Color: A Novel Image Colorization Method

SCGAN: Saliency Map-guided Colorization with Generative Adversarial Network

Satellite Remote Sensing Grayscale Image Colorization Based on Denoising Generative Adversarial Network

Exploring efficient and effective generative adversarial network for thermal infrared image colorization

Dual Color Space Guided Sketch Colorization

Automatic Image Colorization with Convolutional Neural Networks and Generative Adversarial Networks

Grayscale Image Colorization with GAN and CycleGAN in Different Image Domain

TCGAN: Three-Channel Generate Adversarial Network