Abstract:Automatic colorization of gray images with objects of different colors and sizes is challenging due to inter- and intra-object color variation and the small area of the main objects due to extensive backgrounds. The learning process often favors dominant features, resulting in a biased model. In this paper, we formulate the colorization problem into a multinomial classification problem and then apply a weighted function to classes. We propose a set of formulas to transform color values into color classes and vice versa. Class optimization and balancing feature distribution are the keys for good performance. Observing class appearance on various extremely large-scale real-time images in practice, we propose 215 color classes for our colorization task. During training, we propose a class-weighted function based on true class appearance in each batch to ensure proper color saturation of individual objects. We establish a trade-off between major and minor classes to provide orthodox class prediction by eliminating major classes' dominance over minor classes. As we apply regularization to enhance the stability of the minor class, occasional minor noise may appear at the object's edges. We propose a novel object-selective color harmonization method empowered by the SAM to refine and enhance these edges. We propose a new color image evaluation metric, the Chromatic Number Ratio (CNR), to quantify the richness of color components. We compare our proposed model with state-of-the-art models using five different datasets: ADE, Celeba, COCO, Oxford 102 Flower, and ImageNet, in both qualitative and quantitative approaches. The experimental results show that our proposed model outstrips other models in visualization and CNR measurement criteria while maintaining satisfactory performance in regression (MSE, PSNR), similarity (SSIM, LPIPS, UIQI), and generative criteria (FID).

Multi-sparse Dictionary Colorization Algorithm Based on the Feature Classification and Detail Enhancement

An Adaptive Multi-channel Feature-fusion Model for Polyp Classification

Lightweight Deep Exemplar Colorization Via Semantic Attention-Guided Laplacian Pyramid

Natural Grayscale Image Colorization via Local Sparse Coding

Multiple-content Image Colorization Algorithm Based on Classified Dictionary

SCSNet: an Efficient Paradigm for Learning Simultaneously Image Colorization and Super-resolution

Improving reference-based image colorization for line arts via feature aggregation and contrastive learning

MMC: Multi-Modal Colorization of Images using Textual Descriptions

Image colorization using sparse representation

Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization

MultiColor: Image Colorization by Learning from Multiple Color Spaces

CCC: Color Classified Colorization

MMC: Multi-modal colorization of images using textual description

Multi-Spectral Color Data Dimension Reduction Model Research Based on Sparse Representation

A Nonlocal Sparse Representation Method for Color Demosaicking

Method of color reconstruction of greyscale images based onsparse representation of K-means classification

Edge-Aware Multi-Scale Progressive Colorization.

A Dictionary Learning Algorithm for Color Face Recognition

Multichannel color image denoising based on multiple dictionaries learning

Example‐Based Colourization Via Dense Encoding Pyramids

A Multiscale Gradient Fusion Method for Edge Detection in Color Images Utilizing the CBM3D Filter