Abstract:Motion capture is a technique of digitally recording the movements of real entities, usually humans. It was originally developed as an analysis tool in biomechanics research, but has grown increasingly important as a source of motion data for computer animation. In this context it has been widely used for both cinema and video games. Hand motion capture and tracking in particular has received a lot of attention because of its critical role in the design of new Human Computer Interaction methods and gesture analysis. One of the main difficulties is the capture of human hand motion. This paper gives an overview of ongoing research “HandPuppet3D” being carried out in collaboration with an animation studio to employ computer vision techniques to develop a prototype desktop system and associated animation process that will allow an animator to control 3D character animation through the use of hand gestures. The eventual goal of the project is to support existing practice by providing a softer, more intuitive, user interface for the animator that improves the productivity of the animation workflow and the quality of the resulting animations. To help achieve this goal the focus has been placed on developing a prototype camera based desktop gesture capture system to capture hand gestures and interpret them in order to generate and control the animation of 3D character models. This will allow an animator to control 3D character animation through the capture and interpretation of hand gestures. Methods will be discussed for motion tracking and capture in 3D animation and in particular that of hand motion tracking and capture. HandPuppet3D aims to enable gesture capture with interpretation of the captured gestures and control of the target 3D animation software. This involves development and testing of a motion analysis system built from algorithms recently developed. We review current software and research methods available in this area and describe our current work.

PREPRINT: Found Object Puppeteering as a Tool for Rapid Movement Sketching in 3D Animation

A Method of Shadow Puppet Figure Modeling and Animation

Exploitation Of Novel Multiplayer Gesture-Based Interaction And Virtual Puppetry For Digital Storytelling To Develop Children'S Narrative Skills

Exploitation of Multiplayer Interaction and Development of Virtual Puppetry Storytelling Using Gesture Control and Stereoscopic Devices.

Puppetanimator: A Performative Interface for Experiencing Shadow Play

PENCIL: A Framework for Expressing Free-Hand Sketching in 3D

PUPPET MOVEMENTS IN STRUCTURE-SPECIFIC TRADITIONAL PAPER CUT OUT ANIMATION PRODUCTION

HandPuppet3D: Motion capture and analysis for character animation

Exploration of direct bi-manual interaction in digitally mediated stop-motion animation

JOINT AND SEGMENTATION DESIGN ON PAPER PUPPETS FOR CAT CHARACTERS IN CUT OUT STOP MOTION ANIMATION

Virtual Character Animation Based on Affordable Motion Capture and Reconfigurable Tangible Interfaces

End-User Puppeteering of Expressive Movements

4Doodle: 4D Printing Artifacts Without 3D Printers.

ShadowMaker: Sketch-Based Creation Tool for Digital Shadow Puppetry

Double Doodles: Sketching Animation in Immersive Environment With 3+6 DOFs Motion Gestures

An Interactive Motion-Editing Method for Human Animation.

A Video-Based System for Hand-Driven Stop-Motion Animation

A Video-based Interface for Hand-Driven Stop Motion Animation Production

Optimizing Character Animations using Online Crowdsourcing

Mesh Puppetry

Analysis on Laika’s Puppets in Kubo and the Two Strings: A Stop-motion Animated Feature