Abstract:In the animation industry, cartoon videos are usually produced at low frame rate since hand drawing of such frames is costly and time-consuming. Therefore, it is desirable to develop computational models that can automatically interpolate the in-between animation frames. However, existing video interpolation methods fail to produce satisfying results on animation data. Compared to natural videos, animation videos possess two unique characteristics that make frame interpolation difficult: 1) cartoons comprise lines and smooth color pieces. The smooth areas lack textures and make it difficult to estimate accurate motions on animation videos. 2) cartoons express stories via exaggeration. Some of the motions are non-linear and extremely large. In this work, we formally define and study the animation video interpolation problem for the first time. To address the aforementioned challenges, we propose an effective framework, AnimeInterp, with two dedicated modules in a coarse-to-fine manner. Specifically, 1) Segment-Guided Matching resolves the "lack of textures" challenge by exploiting global matching among color pieces that are piece-wise coherent. 2) Recurrent Flow Refinement resolves the "non-linear and extremely large motion" challenge by recurrent predictions using a transformer-like architecture. To facilitate comprehensive training and evaluations, we build a large-scale animation triplet dataset, ATD-12K, which comprises 12,000 triplets with rich annotations. Extensive experiments demonstrate that our approach outperforms existing state-of-the-art interpolation methods for animation videos. Notably, AnimeInterp shows favorable perceptual quality and robustness for animation scenarios in the wild. The proposed dataset and code are available at <a class="link-external link-https" href="https://github.com/lisiyao21/AnimeInterp/" rel="external noopener nofollow">this https URL</a>.

Two-dimensional animation keyframes interpolation based on hierarchical constraints

Skeleton-driven 2D Distance Field Metamorphosis Using Intrinsic Shape Parameters

Learning a Deep Motion Interpolation Network for Human Skeleton Animations

Study on 2D Sketch Representation Method by Non-uniform α-B Interpolation Spline

Sketch Based Multi-source 3D Animation Transfer

Technical Section: 2D shape morphing via automatic feature matching and hierarchical interpolation

2D Shape Blending Based on Multi-Level Feature Structures

Structure Preserving Manipulation and Interpolation for Multi‐element 2D Shapes

Correspondence specification learned from master frames for automatic inbetweening

Thin-Plate Spline-based Interpolation for Animation Line Inbetweening

Robust Diffusion‐based Motion In‐betweening

Bridging the Gap: Sketch-Aware Interpolation Network for High-Quality Animation Sketch Inbetweening

Non‐linear Rough 2D Animation using Transient Embeddings

Deep Animation Video Interpolation in the Wild

Keyframe Control of Music-driven 3D Dance Generation

Deep Sketch-guided Cartoon Video Inbetweening

Research on 2D Animation Simulation Based on Artificial Intelligence and Biomechanical Modeling

Adaptive Skeleton-Driven Cages for Mesh Sequences

Complex Object Correspondence Construction in Two-Dimensional Animation.

Long‐term Motion In‐betweening via Keyframe Prediction

A hybrid approach to animating the murals with Dunhuang style