Abstract:We aim to address a significant but understudied problem in the anime industry, namely the inbetweening of cartoon line drawings. Inbetweening involves generating intermediate frames between two black-and-white line drawings and is a time-consuming and expensive process that can benefit from automation. However, existing frame interpolation methods that rely on matching and warping whole raster images are unsuitable for line inbetweening and often produce blurring artifacts that damage the intricate line structures. To preserve the precision and detail of the line drawings, we propose a new approach, AnimeInbet, which geometrizes raster line drawings into graphs of endpoints and reframes the inbetweening task as a graph fusion problem with vertex repositioning. Our method can effectively capture the sparsity and unique structure of line drawings while preserving the details during inbetweening. This is made possible via our novel modules, i.e., vertex geometric embedding, a vertex correspondence Transformer, an effective mechanism for vertex repositioning and a visibility predictor. To train our method, we introduce MixamoLine240, a new dataset of line drawings with ground truth vectorization and matching labels. Our experiments demonstrate that AnimeInbet synthesizes high-quality, clean, and complete intermediate line drawings, outperforming existing methods quantitatively and qualitatively, especially in cases with large motions. Data and code are available at <a class="link-external link-https" href="https://github.com/lisiyao21/AnimeInbet" rel="external noopener nofollow">this https URL</a>.

Correspondence specification learned from master frames for automatic inbetweening

Joint Stroke Tracing and Correspondence for 2D Animation

Complex Object Correspondence Construction in Two-Dimensional Animation.

Sketch Based Multi-source 3D Animation Transfer

Animating Cartoon Faces by Multi-View Drawings

Deep Sketch-guided Cartoon Video Inbetweening

Electors Voting for Fast Automatic Shape Correspondence

Performance-Driven Animation of Hand-Drawn Cartoon Faces

Graph Based Transductive Learning for Cartoon Correspondence Construction.

Stroke correspondence construction for vector-based 2d animation inbetweening

Bridging the Gap: Sketch-Aware Interpolation Network for High-Quality Animation Sketch Inbetweening

Video Tracked Facial Expression Animation

Deep Geometrized Cartoon Line Inbetweening

Semi-automatic Cartoon Generation by Motion Planning

Cartoon Animation Outpainting With Region-Guided Motion Inference

Diverse Motion In-betweening with Dual Posture Stitching

Long‐term Motion In‐betweening via Keyframe Prediction

Automatic Inbetweening for Stroke‐Based Painterly Animation

Retrieval Based Cartoon Synthesis Via Heterogeneous Features Learning

Automatic Face Modeling and Synthesis Based on Image Pairs

Automatic 3D Face Modeling Using 2D Active Appearance Models