Abstract:Sketch colorization is usually expensive and time-consuming for artists, and automating this process can have many pragmatic applications in the animation, comic book, and video game industry. However, automatic image colorization faces many challenges, because sketches not only lack texture information but also potentially entail complicated objects that require acute coloring. These difficulties usually result in incorrect color assignments that can ruin the aesthetic appeal of the final output. In this paper, we present a novel component-based matching framework that combines deep learned features and quadratic programming with a new cost function to solve this colorization problem. The proposed framework inputs a character's sketches as well as a colored image in the same cut of a movie, and outputs a high-quality sequence of colorized frames based on the color assignment in the reference colored image. To carry out this colorization task, we first utilize a pretrained ResNet-34 model to extract elementary components' features to match certain pairs of components (one component from the sketch and one from reference). Next, a graph representation is constructed in order to process and match the remaining components that could not be done in the first step. Since the first step has reduced the number of components to be matched by the graph, we can solve this graph problem in a short computing time even when there are hundreds of different components present in each sketch. We demonstrate the effectiveness of the proposed solution by conducting comprehensive experiments and producing aesthetically pleasing results. To the best of our knowledge, our framework is the first work that combines deep learning extraction and graph representation to colorize anime sketches and achieves a high pixel-level accuracy at a reasonable time cost.

Automatic colorization for Thangka sketch-based paintings

Thangka Sketch Colorization Based on Multi-Level Adaptive-Instance-Normalized Color Fusion and Skip Connection Attention

Computer Assisted Rendering of Black and White Thangka

Color Restoration Techniques For Faded Mural Of Mogao Grotto

Computer-aided generation of mandala thangka patterns

Language-based colorization of scene sketches

Anime Sketch Colorization by Component-based Matching using Deep Appearance Features and Graph Representation

Automatic Coloring Method for Ethnic Costume Sketch Based on Pix2Pix Network

Hand-drawn Grayscale Image Colorful Colorization Based on Natural Image

UGSC‐GAN: User‐guided sketch colorization with deep convolution generative adversarial networks

Improving reference-based image colorization for line arts via feature aggregation and contrastive learning

Dual Color Space Guided Sketch Colorization

SCGAN: Saliency Map-guided Colorization with Generative Adversarial Network

Application of Intelligent Image Color Technology in Teaching Chinese Painting Color

Computer-aided Colorization State-of-the-science: A Survey

Active Colorization for Cartoon Line Drawings

Double-Channel Guided Generative Adversarial Network for Image Colorization

Multimodal Semantic-Aware Automatic Colorization with Diffusion Prior

Automatic Controllable Colorization via Imagination

A learning-based approach for automatic image and video colorization

Automatic Background Adjustment for Chinese Paintings Using Pigment Lines.