Abstract:Image colorization has a wide range of applications, but it remains a challenging task due to it is an inherently ill-posed problem with multi-modal uncertainty. The advancement of deep learning techniques has provided extensive avenues for addressing image colorization. However, current works mainly suffer from two problems: inaccurate colorization leading to biased color tones (e.g., cool or warm bias) and undersaturation of images. Existing Transformer-based methods can produce impressive results, but they often come with high training costs and may result in color overflow effects. In this paper, we propose a two-stage image colorization strategy based on a color codebook. Clustering methods in the three-dimensional CIE Lab color space is proposed to integrate brightness information so that the colors in the codebook can be lifelike. In the first stage, we treat the colorization task as a classification problem based on a color codebook, and a high-quality codebook is advantageous for enhancing color classification accuracy. In the second stage, different from the traditional Transformer-based method, a pyramid-type Transformer structure is used to extract rich image features to refine the colors, which can solve potential color bands, color errors and color overflow. In addition, the parameters and FLOPs are significantly smaller than other traditional Transformer-based methods. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches. On the ImageNet validation set, the achieved values are 4.60, 25.23, 0.19, and 39.82 in terms of FID, PSNR, LPIPS, and CF, respectively. On the COCO-Stuff validation set, the achieved values are 5.62, 25.15, 0.19, and 36.25 in terms of FID, PSNR, LPIPS, and CF, respectively. The codes are available at https://github.com/Tanghui2000/Two-stage_Image_Colorization_via_Color_Codebook .

Fast Image Colourisation Based on Twin-Codebook Vector Quantisation

Fast Image Artistic Style Learning Using Twin-Codebook Vector Quantization.

A Novel Color Image Segmentation Algorithm Based on Vector Quantization and Region Growing

Colour image retrieval using pattern co-occurrence matrices based on BTC and VQ

Image Coding Based on Classified Vector Quantisation Using Edge Orientation Patterns.

Fast Codebook Design Method for Image Vector Quantisation

VQ Image Coding Using Sub-Vector Techniques.

Hybrid Image Compression Scheme Based on PVQ and DCTVQ.

Colour Image Retrieval Based on DCT-domain Vector Quantisation Index Histograms

A Fast Image Coding Algorithm Using Variable-Rate Mean-Match Correlation Vector Quantization

Color Image Retrieval Utilizing Extended Fast Vq Codeword Search Technique And Vector Composition-Based Feedback

Image Compression Algorithms Based on Side-Match Vector Quantizer with Gradient-Based Classifiers

&Lt;title>image Coding Using Variable-Rate Classified Side-Match Vector Quantization</title>

Edge and Contrast Classified K-means Algorithm for Image Vector Quantizer Design.

Image Coding Based on Classified Side-Match Vector Quantization

A Spatial/Frequency Hybrid Vector Quantizer Based on a Classification in the DCT Domain

Image Compression Based on Mean Value Predictive Vector Quantization.

Two-stage image colorization via color codebook

Image Coding Using SMVQ with Two-Level Block Classifier

An Efficient Btc Image Compression Algorithm With Vector Quantization

Vector Quantization Based On Genetic Algorithm