Abstract:Recent methods based on deep learning have shown promise in converting grayscale images to colored ones. However, most of them only allow limited user inputs (no inputs, only global inputs, or only local inputs), to control the output colorful images. The possible difficulty lies in how to differentiate the influences of different inputs. To solve this problem, we propose a two-stage deep colorization method allowing users to control the results by flexibly setting global inputs and local inputs. The key steps include enabling color themes as global inputs by extracting <inline-formula><tex-math notation="LaTeX">$K$</tex-math></inline-formula> mean colors and generating <inline-formula><tex-math notation="LaTeX">$K$</tex-math></inline-formula> -color maps to define a global theme loss, and designing a loss function to differentiate the influences of different inputs without causing artifacts. We also propose a color theme recommendation method to help users choose color themes. Based on the colorization model, we further propose an image compression scheme, which supports variable compression ratios in a single network. Experiments on colorization show that our method can flexibly control the colorized results with only a few inputs and generate state-of-the-art results. Experiments on compression show that our method achieves much higher image quality at the same compression ratio when compared to the state-of-the-art methods.

Grey-Scale Image Colorization by Local Correlation Based Optimization Algorithm.

A New Algorithm for Colorizing Grayscale Image Based on Pixel Correlation

Colorization Using Optimization

Optimization Based Grayscale Image Colorization

Natural Grayscale Image Colorization via Local Sparse Coding

Efficient Global Color, Luminance, and Contrast Consistency Optimization for Multiple Remote Sensing Images

Fast Colorization Using Edge And Gradient Constrains

Real-Color Image Denoised and Enhanced Synchronously Based on Wavelet Transform

Gray-scale image colorization based on the control of single-parameter

Gray Image Colorization Algorithm Based on Image Segmentation and Region Matching

Fast Image Colorization Based on Local and Global Consistency

Grayscale Image Colorization Using an Adaptive Weighted Average Method

Automatic Colorization with Improved Spatial Coherence and Boundary Localization.

A learning-based approach for automatic image and video colorization

A New Colorization Algorithm Based on Dynamic Neighbor-Relevant Chromatic Channel Information

Sketching Local Color Transfer

A Superpixel-Based Variational Model for Image Colorization

GcsDecolor: Gradient Correlation Similarity for Efficient Contrast Preserving Decolorization.

Structure-Aware Nonlocal Optimization Framework for Image Colorization

Saliency-Guided Color-to-Gray Conversion Using Region-Based Optimization

Interactive Deep Colorization and its Application for Image Compression