Abstract:Animation production workflows centred around motion capture techniques often require animators to edit the motion for various artistic and technical reasons. This process generally uses a set of keyframes. Unsupervised keyframe selection methods for motion capture sequences are highly demanded to reduce the laborious annotations. However, most existing methods are optimization-based, which cause the issues of flexibility and efficiency and eventually constrains the interactions and controls with animators. To address these limitations, we propose a novel graph based deep reinforcement learning method for efficient unsupervised keyframe selection. First, a reward function is devised in terms of reconstruction difference by comparing the original sequence and the interpolated sequence produced by the keyframes. The reward complies with the requirements of the animation pipeline satisfying: 1) incremental reward to evaluate the interpolated keyframes immediately; 2) order insensitivity for consistent evaluation; and 3) non-diminishing return for comparable rewards between optimal and sub-optimal solutions. Then by representing each skeleton frame as a graph, a graph-based deep agent is guided to heuristically select keyframes to maximize the reward. During the inference it is no longer necessary to estimate the reconstruction difference, and the evaluation time can be reduced significantly. The experimental results on the CMU Mocap dataset demonstrate that our proposed method is able to select keyframes at a high efficiency without clearly compromising the quality in comparison with the state-of-the-art methods.

Key-Frame Extraction from Motion Capture Data

An Efficient Keyframe Extraction from Motion Capture Data

Extraction of Keyframe of Motion Capture Data Based on Layered Curve Simplification

Extraction of Key-frame from Motion Capture Data Based on Pre-selection and Reconstruction Error Optimization

Optimization-based key frame extraction for motion capture animation

Key frame extraction from motion capture data based on gpu

New Fusional Framework Combining Sparse Selection and Clustering for Key Frame Extraction.

Dynamic Programming Based Key-frame Extraction Algorithm

An Efficient Method of Key-Frame Extraction Based on a Cluster Algorithm

Motion Key-frames extraction based on amplitude of distance characteristic curve

Key Frames Extraction from Human Motion Capture Data Based on Hybrid Particle Swarm Optimization Algorithm

Keyframe Extraction From Human Motion Capture Data Based On A Multiple Population Genetic Algorithm

Technique of key-frame extraction and motion editing based on wavelet transform

3D Human Motion Retrieval Based on Key-Frames

Key Frame Extraction Based on Spatiotemporal Motion Trajectory

Motion Key-Frames Extraction Based on Locally Linear Embedding

Keyframe Extraction from Motion Capture Sequences with Graph based Deep Reinforcement Learning

Motion Key-Frame Extraction By Using Optimized T-Stochastic Neighbor Embedding

Key frame extraction based on quaternion Fourier transform with multiple features fusion

Keyframe Extraction and Loop Closure Detection Considering Robot Motion

Fast Computation of Transition Points for Motion Graph