Abstract:Animating various character drawings is an engaging visual content creation task. Given a single character drawing, existing animation methods are limited to flat 2D motions and thus lack 3D effects. An alternative solution is to reconstruct a 3D model from a character drawing as a proxy and then retarget 3D motion data onto it. However, the existing image-to-3D methods could not work well for amateur character drawings in terms of appearance and geometry. We observe the contour lines, commonly existing in character drawings, would introduce significant ambiguity in texture synthesis due to their view-dependence. Additionally, thin regions represented by single-line contours are difficult to reconstruct (e.g., slim limbs of a stick figure) due to their delicate structures. To address these issues, we propose a novel system, DrawingSpinUp, to produce plausible 3D animations and breathe life into character drawings, allowing them to freely spin up, leap, and even perform a hip-hop dance. For appearance improvement, we adopt a removal-then-restoration strategy to first remove the view-dependent contour lines and then render them back after retargeting the reconstructed character. For geometry refinement, we develop a skeleton-based thinning deformation algorithm to refine the slim structures represented by the single-line contours. The experimental evaluations and a perceptual user study show that our proposed method outperforms the existing 2D and 3D animation methods and generates high-quality 3D animations from a single character drawing. Please refer to our project page (<a class="link-external link-https" href="https://lordliang.github.io/DrawingSpinUp" rel="external noopener nofollow">this https URL</a>) for the code and generated animations.

Sketch Based Multi-source 3D Animation Transfer

Animating Cartoon Faces by Multi-View Drawings

Sketch-based skeleton-driven 2D animation and motion capture

Cartoon Character Animation from Multi-view Hand-Drawings

Performance-Driven Animation of Hand-Drawn Cartoon Faces

SketchAnim: Real‐time sketch animation transfer from videos

Sketch Pose: A Reusable Motion Representation for 2D Cartoon Animation

Expression-Driven Sketch Animation

A Video-driven Approach to 3D Human Animation Synthesis

Deep Sketch-guided Cartoon Video Inbetweening

Sketch-2-4d: Sketch Driven Dynamic 3d Scene Generation

Animation Of 3d Characters From Single Depth Camera

SketchBetween: Video-to-Video Synthesis for Sprite Animation via Sketches

Deep3DSketch+\+: High-Fidelity 3D Modeling from Single Free-hand Sketches

2D Cartoon Character Deformation by Sketch Skeleton

Rapid 3D Human Modeling and Animation Based on Sketch and Motion Database

Synthesizing Moving People with 3D Control

Animation Design Using Sketching

DrawingSpinUp: 3D Animation from Single Character Drawings

Sketch Me A Video

Survey of Sketch-Based Technique Aiding 3D Animation