Abstract:Exemplar-based colorization aims to generate plausible colors for a grayscale image with the guidance of a color reference image. The main challenging problem is finding the correct semantic correspondence between the target image and the reference image. However, the colors of the object and background are often confused in the existing methods. Besides, these methods usually use simple encoder-decoder architectures or pyramid structures to extract features and lack appropriate fusion mechanisms, which results in the loss of high-frequency information or high complexity. To address these problems, this paper proposes a lightweight semantic attention-guided Laplacian pyramid network (SAGLP-Net) for deep exemplar-based colorization, exploiting the inherent multi-scale properties of color representations. They are exploited through a Laplacian pyramid, and semantic information is introduced as high-level guidance to align the object and background information. Specially, a semantic guided non-local attention fusion module is designed to exploit the long-range dependency and fuse the local and global features. Moreover, a Laplacian pyramid fusion module based on criss-cross attention is proposed to fuse high frequency components in the large-scale domain. An unsupervised multi-scale multi-loss training strategy is further introduced for network training, which combines pixel loss, color histogram loss, total variance regularisation, and adversarial loss. Experimental results demonstrate that our colorization method achieves better subjective and objective performance with lower complexity than the state-of-the-art methods.

Deep Exemplar-Based Color Transfer for 3D Model

Transferring Color Between Three-Dimensional Objects

Ihair Recolorer: Deep Image-to-video Hair Color Transfer

AdaCM: Adaptive ColorMLP for Real-Time Universal Photo-realistic Style Transfer

Deep Exemplar-based Colorization

L0 Gradient-Preserving Color Transfer

Improved method of image color transfer.

Progressive Color Transfer with Dense Semantic Correspondences

Saliency Guided Deep Neural Network for Color Transfer With Light Optimization

Deep Near Infrared Colorization with Semantic Segmentation and Transfer Learning.

Color Transfer Based on Earth Mover's Distance and Color Categorization

Lightweight Deep Exemplar Colorization Via Semantic Attention-Guided Laplacian Pyramid

Palette-based Color Transfer between Images

Color Transfer for Images: A Survey

Region-Based Color Transfer for Complex Content Images Using Intrinsic Component

Example-Based Color Transfer for Gradient Meshes.

Homogenous Color Transfer Using Texture Retrieval and Matching.

Digital Makeup from Internet Images

Auto-colorization of 3D Models from Images

Im2Avatar: Colorful 3D Reconstruction from a Single Image

Semantic-Sparse Colorization Network for Deep Exemplar-based Colorization