Abstract:Forecasting human motion from a sequence of human poses is an important problem in the fields of computer vision and robotics. Most previous approaches merely consider learning the temporal dynamics of body joints or joint angles, while neglect derivatives of body joints (i.e., pose velocities) which could reasonably reduce noise impact and improve stability. To exploit the benefits of pose velocities, we propose the velocity-to-velocity learning paradigm for human motion prediction which attempts to directly build the sequence-to-sequence model in the velocity space. Two variant architectures based on recurrent encoder-decoder networks are introduced under this paradigm. Considering human motion as kinematics of rigid bodies, joint angles which denote transformation are the computations of inverse kinematics. Accordingly, a novel loss function in terms of rotation matrices is designed during training for human motion prediction through a rotation matrix transformation (RMT) layer. Finally, we present an effective training algorithm which exploits sequence transformation to improve model generalization. Our approaches substantially outperform state-of-the-art approaches on two large-scale datasets, Human3.6M and CMU Motion Capture, for both short-term prediction and long-term prediction. In particular, our model can competently forecast human-like and meaningful poses up to 1000 milliseconds. The code is available on GitHub: https://github.com/hongsong-wang/RNN_based_human_motion_prediction.

Recent advances in deterministic human motion prediction: A review

3D Human Motion Prediction: A Survey

Forecasting Distillation: Enhancing 3D Human Motion Prediction with Guidance Regularization

Human motion trajectory prediction: a survey

Robust Real-Time Motion Retargeting Via Neural Latent Prediction

Human motion prediction for intelligent construction: A review

A Data-Efficient Approach for Long-Term Human Motion Prediction Using Maps of Dynamics

Human Motion Modeling with Deep Learning: A Survey

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

A Survey on Trajectory-Prediction Methods for Autonomous Driving

On human motion prediction using recurrent neural networks

Towards Practical Human Motion Prediction with LiDAR Point Clouds

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

Experimental Evaluation of Human Motion Prediction: Toward Safe and Efficient Human Robot Collaboration

Human Motion Prediction under Unexpected Perturbation

History Repeats Itself: Human Motion Prediction via Motion Attention

Human Joint Kinematics Diffusion-Refinement for Stochastic Motion Prediction

DMS-GCN: Dynamic Mutiscale Spatiotemporal Graph Convolutional Networks for Human Motion Prediction

Velocity-to-velocity human motion forecasting

Human Trajectory Prediction using Spatially aware Deep Attention Models