Abstract:Depth sensor based 3D human motion estimation hardware such as Kinect has made interactive applications more popular recently. However, it is still challenging to accurately recognize postures from a single depth camera due to the inherently noisy data derived from depth images and self-occluding action performed by the user. In this paper, we propose a new real-time probabilistic framework to enhance the accuracy of live captured postures that belong to one of the action classes in the database. We adopt the Gaussian Process model as a prior to leverage the position data obtained from Kinect and marker-based motion capture system. We also incorporate a temporal consistency term into the optimization framework to constrain the velocity variations between successive frames. To ensure that the reconstructed posture resembles the accurate parts of the observed posture, we embed a set of joint reliability measurements into the optimization framework. A major drawback of Gaussian Process is its cubic learning complexity when dealing with a large database due to the inverse of a covariance matrix. To solve the problem, we propose a new method based on a local mixture of Gaussian Processes, in which Gaussian Processes are defined in local regions of the state space. Due to the significantly decreased sample size in each local Gaussian Process, the learning time is greatly reduced. At the same time, the prediction speed is enhanced as the weighted mean prediction for a given sample is determined by the nearby local models only. Our system also allows incrementally updating a specific local Gaussian Process in real time, which enhances the likelihood of adapting to run-time postures that are different from those in the database. Experimental results demonstrate that our system can generate high quality postures even under severe self-occlusion situations, which is beneficial for real-time applications such as motion-based gaming and sport training.

Inverse kinematics based on statistical learning

A Joint Physical Constraints Avoidance Method for Inverse Kinematics Problem of Redundant Humanoid Manipulator

Inverse kinematics using dynamic joint parameters: inverse kinematics animation synthesis learnt from sub-divided motion micro-segments

A constrained inverse kinematics technique for real-time motion capture animation

A Real-Time Inverse Kinematics Algorithm for Human Motion Modeling

Human Motion Capture Using Wireless Inertial Sensors

Real Time Falling Animation with Active and Protective Responses

Learning-based pose edition for efficient and interactive design

A language‐directed virtual human motion generation approach based on musculoskeletal models

Optimization algorithm of an artificial neural network-based controller and simulation method for animated virtual idol characters

A Human Motion Feature Based on Semi-Supervised Learning of GMM

Kinect Posture Reconstruction Based on a Local Mixture of Gaussian Process Models

Research on 2D Animation Simulation Based on Artificial Intelligence and Biomechanical Modeling

Improved Damped Least Squares Solution with Joint Limits, Joint Weights and Comfortable Criteria for Controlling Human-like Figures.

A generalised smoothing approach for continuous, planar, inverse kinematics problems

Learning Reduced-Order Feedback Policies for Motion Skills

A Multi-Stage Approach for Efficiently Learning Humanoid Robot Stand-Up Behavior

3D Kinematics Estimation from Video with a Biomechanical Model and Synthetic Training Data

Motion Synthesis Using Style-Editable Inverse Kinematics

Euclidean Equivariant Models for Generative Graphical Inverse Kinematics

An Interactive Framework for Visually Realistic 3D Motion Synthesis using Evolutionarily-trained Spiking Neural Networks