Abstract:Given a target grayscale image and a reference color image, exemplar-based image colorization aims to generate a visually natural-looking color image by transforming meaningful color information from the reference image to the target image. It remains a challenging problem due to the differences in semantic content between the target image and the reference image. In this paper, we present a novel globally and locally semantic colorization method called exemplar-based conditional broad-GAN, a broad generative adversarial network (GAN) framework, to deal with this limitation. Our colorization framework is composed of two sub-networks: the match sub-net and the colorization sub-net. We reconstruct the target image with a dictionary-based sparse representation in the match sub-net, where the dictionary consists of features extracted from the reference image. To enforce global-semantic and local-structure self-similarity constraints, global-local affinity energy is explored to constrain the sparse representation for matching consistency. Then, the matching information of the match sub-net is fed into the colorization sub-net as the perceptual information of the conditional broad-GAN to facilitate the personalized results. Finally, inspired by the observation that a broad learning system is able to extract semantic features efficiently, we further introduce a broad learning system into the conditional GAN and propose a novel loss, which substantially improves the training stability and the semantic similarity between the target image and the ground truth. Extensive experiments have shown that our colorization approach outperforms the state-of-the-art methods, both perceptually and semantically.

Grayscale Image Colorization with GAN and CycleGAN in Different Image Domain

Image Colorization using CycleGAN with semantic and spatial rationality

Automatic Coloring of Anime Line Art Based on Improved CycleGAN

Towards Vivid and Diverse Image Colorization with Generative Color Prior

Double-Channel Guided Generative Adversarial Network for Image Colorization

Fine‐grained semantic ethnic costume high‐resolution image colorization with conditional GAN

SAR Image Colorization Using Multidomain Cycle-Consistency Generative Adversarial Network

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

An Extensive Study of Cycle-Consistent Generative Networks for Image-to-Image Translation

SPDGAN: A Generative Adversarial Network based on SPD Manifold Learning for Automatic Image Colorization

Transforming Color: A Novel Image Colorization Method

Globally and Locally Semantic Colorization via Exemplar-Based Broad-GAN

Optimization of image style transfer algorithm based on CycleGAN

Color Constancy by GANs: An Experimental Survey

ChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution

cGAN-based Manga Colorization Using a Single Training Image

SCGAN: Saliency Map-guided Colorization with Generative Adversarial Network

Unsupervised Diverse Colorization via Generative Adversarial Networks

Ecgan: Image Translation With Multi-Scale Relativistic Average Discriminator

Satellite Remote Sensing Grayscale Image Colorization Based on Denoising Generative Adversarial Network