Abstract:In the animation industry, cartoon videos are usually produced at low frame rate since hand drawing of such frames is costly and time-consuming. Therefore, it is desirable to develop computational models that can automatically interpolate the in-between animation frames. However, existing video interpolation methods fail to produce satisfying results on animation data. Compared to natural videos, animation videos possess two unique characteristics that make frame interpolation difficult: 1) cartoons comprise lines and smooth color pieces. The smooth areas lack textures and make it difficult to estimate accurate motions on animation videos. 2) cartoons express stories via exaggeration. Some of the motions are non-linear and extremely large. In this work, we formally define and study the animation video interpolation problem for the first time. To address the aforementioned challenges, we propose an effective framework, AnimeInterp, with two dedicated modules in a coarse-to-fine manner. Specifically, 1) Segment-Guided Matching resolves the "lack of textures" challenge by exploiting global matching among color pieces that are piece-wise coherent. 2) Recurrent Flow Refinement resolves the "non-linear and extremely large motion" challenge by recurrent predictions using a transformer-like architecture. To facilitate comprehensive training and evaluations, we build a large-scale animation triplet dataset, ATD-12K, which comprises 12,000 triplets with rich annotations. Extensive experiments demonstrate that our approach outperforms existing state-of-the-art interpolation methods for animation videos. Notably, AnimeInterp shows favorable perceptual quality and robustness for animation scenarios in the wild. The proposed dataset and code are available at <a class="link-external link-https" href="https://github.com/lisiyao21/AnimeInterp/" rel="external noopener nofollow">this https URL</a>.

Color-independent classification of animation video

Automatic And Robust Classification Of Independent Motions In Video Sequences

Feature Analysis and Classification for Filtering Junk Information in Animation

An Effective Method for Video Genre Classification.

Video Anomaly Detection and Localization Based on an Adaptive Intra-Frame Classification Network

Deep Animation Video Interpolation in the Wild

An Automatic Image and Video Colorization Algorithm Based on Pattern Continuity

CAST: Character labeling in Animation using Self-supervision by Tracking

Content-Enriched Classifier For Web Video Classification

Classifying web videos using a global video descriptor

Robust And Automatic Video Colorization Via Multiframe Reordering Refinement

Semi-supervised and Deep learning Frameworks for Video Classification and Key-frame Identification

Content-Based Video Browsing by Text Region Localization and Classification

Content-Based Video Shot Classifacation

Temporally Coherent Video Cartoonization for Animation Scenery Generation

Video2GIF: Automatic Generation of Animated GIFs from Video

A Textural Based Hidden Markov Model for Animation Genre Discrimination

&Lt;title>knowledge-Based Approach to Video Content Classification</title>

An Intra-Frame Classification Network for Video Anomaly Detection and Localization.

Classification of Aesthetic Natural Scene Images Using Statistical and Semantic Features