Abstract:Line art colorization plays a crucial role in hand-drawn animation production, where digital artists manually colorize segments using a paint bucket tool, guided by RGB values from character color design sheets. This process, often called paint bucket colorization, involves two main tasks: keyframe colorization, where colors are applied according to the character's color design sheet, and consecutive frame colorization, where these colors are replicated across adjacent frames. Current automated colorization methods primarily focus on reference-based and segment-matching approaches. However, reference-based methods often fail to accurately assign specific colors to each region, while matching-based methods are limited to consecutive frame colorization and struggle with issues like significant deformation and occlusion. In this work, we introduce inclusion matching, which allows the network to understand the inclusion relationships between segments, rather than relying solely on direct visual correspondences. By integrating this approach with segment parsing and color warping modules, our inclusion matching pipeline significantly improves performance in both keyframe colorization and consecutive frame colorization. To support our network's training, we have developed a unique dataset named PaintBucket-Character, which includes rendered line arts alongside their colorized versions and shading annotations for various 3D characters. To replicate industry animation data formats, we also created color design sheets for each character, with semantic information for each color and standard pose reference images. Experiments highlight the superiority of our method, demonstrating accurate and consistent colorization across both our proposed benchmarks and hand-drawn animations.

Studies on anime-illustration to body-outline translation

Parsing-Conditioned Anime Translation: A New Dataset and Method

Collaborative Neural Rendering using Anime Character Sheets

Appearance-preserved Portrait-to-anime Translation via Proxy-guided Domain Adaptation

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Expression Domain Translation Network for Cross-domain Head Reenactment

Examination of Transformation Technique from Real World to ANIME World

Technical Illustration Based on Human-Like Approach

Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation

Towards Fully Automated Manga Translation

Improving reference-based image colorization for line arts via feature aggregation and contrastive learning

A New Approch For Automatic Rendering Of Pen-And-Ink Illustrations

User-Guided Anime Line Art Colorization with Spatially-adaptive Normalization

Talking Head(?) Anime from a Single Image 4: Improved Model and Its Distillation

WebtoonMe: A Data-Centric Approach for Full-Body Portrait Stylization

Make-It-Animatable: An Efficient Framework for Authoring Animation-Ready 3D Characters

Paint Bucket Colorization Using Anime Character Color Design Sheets

Deep Geometrized Cartoon Line Inbetweening

Illustrated character face super-deformation via unsupervised image-to-image translation

PAniC-3D: Stylized Single-view 3D Reconstruction from Portraits of Anime Characters

A Semi-Automatic Oriental Ink Painting Framework for Robotic Drawing From 3D Models