Abstract:In the monochrome-color dual-lens system, the gray image captured by the monochrome camera has better quality than the color image from the color camera, but does not have color information. To get high-quality color images, it is desired to colorize the gray image with the color image as reference. Related works usually use hand-crafted methods to search for the best-matching pixel in the reference image for each pixel in the input gray image, and copy the color of the best-matching pixel as the result. We propose a novel deep convolution network to solve the colorization problem in an end-to-end way. Based on our observation that, for each pixel in the input image, there usually exist multiple pixels in the reference image that have the correct colors, our method performs weighted average of colors of the candidate pixels in the reference image to utilize more candidate pixels with correct colors. The weight values between pixels in the input image and the reference image are obtained by learning a weight volume using deep feature representations, where an attention operation is proposed to focus on more useful candidate pixels and a 3-D regulation is performed to learn with context information. In addition, to correct wrongly colorized pixels in occlusion regions, we propose a color residue joint learning module to correct the colorization result with the input gray image as guidance. We evaluate our method on the Scene Flow, Cityscapes, Middlebury, and Sintel datasets. Experimental results show that our method largely outperforms the state-of-the-art methods.

Colorization Using Neural Network Ensemble.

Scene Guided Colorization Using Neural Networks

An Ensemble Colorization Method

Image Colorization Algorithm Based on Deep Learning

Gray2ColorNet: Transfer More Colors from Reference Image

Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System.

Grayscale Images Colorization with Convolutional Neural Networks

MultiColor: Image Colorization by Learning from Multiple Color Spaces

Attention-Based Grayscale Image Colorization

ColorUNet: A convolutional classification approach to colorization

Remote Sensing Image Colorization Based on Deep Neural Networks with Multi-Scale Residual Receptive Filed

Automatic Image Colorization with Convolutional Neural Networks and Generative Adversarial Networks

Color-UNet++: A resolution for colorization of grayscale images using improved UNet++

Incorporating Ensemble and Transfer Learning For An End-To-End Auto-Colorized Image Detection Model

Automatic Colorization Using Fully Convolutional Networks

Ensemble Learning Based Multi-Color Space in Convolutional Neural Network

Colorful Image Colorization

Color-UNet plus plus : A resolution for colorization of grayscale images using improved UNet plus

Exemplar-Based Image Colorization with A Learning Framework

ColorGAN: Automatic Image Colorization with GAN

Real-Time User-Guided Image Colorization with Learned Deep Priors