Abstract:Human motion prediction is a popular method to predict future motion sequences based on past sequences, which is widely used in human-computer interaction. Space-time-separable graph Convolutional Network (STS-GCN) is a conventional mathematical model for human motion prediction. However, the uncertainty of human movements often leads to the problem of significant prediction error in the prediction results. This paper first proposed a Multi-scale STS-GCN (MSTS-GCN) model based on the conventional STS-GCN method to find the relevant factors that affect the prediction results. In our study, the constructed Multi-scale Temporal Convolutional Network (MTCN) decoder effectively reduced the human motion prediction error at specific time nodes. To expand the transmission and utilization performance in a larger receptive field, a Gated Recurrent Unit-TCN decoder was also designed. Finally, a new STS-GCN (NSTS-GCN) human motion prediction model was proposed, which realized the transmission and utilization of motion sequence features under a larger temporal perceptual field. To verify the effectiveness of NSTS-GCN, the Human3.6M dataset, AMASS, and 3DPW dataset were tested. The experimental results show that the MPJPE error of the proposed model for human joint prediction at each time node is reduced compared with the conventional STS-GCN model, and the mean reduction was achieved by 3.0mm. All the experimental results validated the effectiveness of the proposed NSTS-GCN model, which further improved the performance of human motion prediction.

RNN -Based Human Motion Prediction Via Differential Sequence Representation

Multitask Non-Autoregressive Model For Human Motion Prediction

Velocity-to-velocity human motion forecasting

Learning a Deep Motion Interpolation Network for Human Skeleton Animations

Forecasting Distillation: Enhancing 3D Human Motion Prediction with Guidance Regularization

Human motion prediction with gated recurrent unit model of multi-dimensional input

Parallel multi-stage rectification networks for 3D skeleton-based motion prediction

On human motion prediction using recurrent neural networks

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction

Past Movements-Guided Motion Representation Learning for Human Motion Prediction

Stacked residual blocks based encoder-decoder framework for human motion prediction

3D Human Motion Prediction: A Survey

DMS-GCN: Dynamic Mutiscale Spatiotemporal Graph Convolutional Networks for Human Motion Prediction

A Data-Efficient Approach for Long-Term Human Motion Prediction Using Maps of Dynamics

Probabilistic Human Motion Prediction Via A Bayesian Neural Network

Neural Ordinary Differential Equation for Irregular Human Motion Prediction

An Attractor-Guided Neural Networks for Skeleton-Based Human Motion Prediction

MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motions

Human Motion Prediction Based on Space-Time-Separable Graph Convolutional Network

Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Prediction