Abstract:Animation production workflows centred around motion capture techniques often require animators to edit the motion for various artistic and technical reasons. This process generally uses a set of keyframes. Unsupervised keyframe selection methods for motion capture sequences are highly demanded to reduce the laborious annotations. However, most existing methods are optimization-based, which cause the issues of flexibility and efficiency and eventually constrains the interactions and controls with animators. To address these limitations, we propose a novel graph based deep reinforcement learning method for efficient unsupervised keyframe selection. First, a reward function is devised in terms of reconstruction difference by comparing the original sequence and the interpolated sequence produced by the keyframes. The reward complies with the requirements of the animation pipeline satisfying: 1) incremental reward to evaluate the interpolated keyframes immediately; 2) order insensitivity for consistent evaluation; and 3) non-diminishing return for comparable rewards between optimal and sub-optimal solutions. Then by representing each skeleton frame as a graph, a graph-based deep agent is guided to heuristically select keyframes to maximize the reward. During the inference it is no longer necessary to estimate the reconstruction difference, and the evaluation time can be reduced significantly. The experimental results on the CMU Mocap dataset demonstrate that our proposed method is able to select keyframes at a high efficiency without clearly compromising the quality in comparison with the state-of-the-art methods.

An Efficient Keyframe Extraction from Motion Capture Data

Extraction of Keyframe of Motion Capture Data Based on Layered Curve Simplification

Extraction of Key-frame from Motion Capture Data Based on Pre-selection and Reconstruction Error Optimization

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Key frame extraction from motion capture data based on gpu

Optimization-based key frame extraction for motion capture animation

Key-Frame Extraction from Motion Capture Data

A Novel Compact Yet Rich Key Frame Creation Method for Compressed Video Summarization

An Efficient Method of Key-Frame Extraction Based on a Cluster Algorithm

Dynamic Programming Based Key-frame Extraction Algorithm

Motion Key-frames extraction based on amplitude of distance characteristic curve

Keyframe Extraction from Motion Capture Sequences with Graph based Deep Reinforcement Learning

Technique of key-frame extraction and motion editing based on wavelet transform

Motion Key-Frame Extraction By Using Optimized T-Stochastic Neighbor Embedding

Key Frame Extraction Based on Spatiotemporal Motion Trajectory

Keyframe Extraction From Human Motion Capture Data Based On A Multiple Population Genetic Algorithm

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Motion Key-Frames Extraction Based on Locally Linear Embedding

A New Motion Editing Algorithm Based On Motion Capture Data

Key Frames Extraction from Human Motion Capture Data Based on Hybrid Particle Swarm Optimization Algorithm

Keyframe Extraction from Laparoscopic Videos Via Diverse and Weighted Dictionary Selection