Progressive Colorization Via Iterative Generative Models

Jinjie Zhou,Kai Hong,Tao Deng,Yuhao Wang,Qiegen Liu
DOI: https://doi.org/10.1109/lsp.2020.3037690
2020-01-01
IEEE Signal Processing Letters
Abstract:Colorization is the process of coloring monochrome images. It has been widely used in photo processing and scientific illustration. However, colorizing grayscale images is an intrinsic ill-posed and ambiguous problem, with multiple plausible solutions. To address this issue, we develop a novel progressive automatic colorization via iterative generative models (iGM) that can produce satisfactory colorization in an unsupervised manner. In particular, the generative model is exploited in multi-color spaces (e.g., RGB, YCbCr) jointly and enforced with linearly autocorrelative constraint. This is regarded as the key prior information to pave the way for producing the most probable colorization in high-dimensional space. Experiments on indoor and outdoor scenes reveal that iGM produces more realistic and finer results, compared to state-of-the-arts.
What problem does this paper attempt to address?