Abstract:Human motion prediction is the key technology for many real-life applications, e.g., self-driving and human–robot interaction. The recent approaches adopt the unrestricted full-connection graph representation to capture the relationships inside the human skeleton. However, there are two issues to be solved: (i) these unrestricted full-connection graph representation methods neglect the inherent dependencies across the joints of the human body; (ii) these methods represent human motions using the features extracted from a single level and thus can neither fully exploit the various connection relationships among the human body nor guarantee the human motion prediction results to be reasonable. To tackle the above issues, we propose an adaptive multi-level hypergraph convolution network (AMHGCN), which uses the adaptive multi-level hypergraph representation to capture various dependencies among the human body. Our method has four different levels of hypergraph representations, including (i) the joint-level hypergraph representation to capture inherent kinetic dependencies in the human body, (ii) the part-level hypergraph representation to exploit the kinetic characteristics at a higher level (in comparison to the joint-level) by viewing some part of the human body as an entirety, (iii) the component-level hypergraph representation to model the semantic information, and (iv) the global-level hypergraph representation to extract long-distance dependencies in the human body. In addition, to take full advantage of the knowledge carried in the training data, we propose a reverse loss ( i.e., adopting the future human poses to predict the historical poses reversely) to realize data augmentation. Extensive experiments show that our proposed AMHGCN can achieve state-of-the-art performance on three benchmarks, i.e., Human3.6M, CMU-Mocap, and 3DPW.

Class-guided Human Motion Prediction Via Multi-Spatial-temporal Supervision

Forecasting Distillation: Enhancing 3D Human Motion Prediction with Guidance Regularization

Temporal Constrained Feasible Subspace Learning for Human Pose Forecasting

Multiscale Spatial and Temporal Learning for Human Motion Prediction

Towards Accurate 3D Human Motion Prediction from Incomplete Observations

DMS-GCN: Dynamic Mutiscale Spatiotemporal Graph Convolutional Networks for Human Motion Prediction

Motion Prediction Using Trajectory Cues

3D Skeleton-Based Human Motion Prediction Using Spatial–temporal Graph Convolutional Network

Multi-granularity Spatial Temporal Graph Convolution Network with Consecutive Attention for Human Motion Prediction

Multimodal Sense-Informed Prediction of 3D Human Motions

Spatiotemporal Consistency Learning from Momentum Cues for Human Motion Prediction

Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction

Multi-level Motion Attention for Human Motion Prediction

Multi-Scale Spatio-Temporal Aggregation Network for Human Motion Prediction.

AMHGCN: Adaptive multi-level hypergraph convolution network for human motion prediction

Learning Progressive Joint Propagation for Human Motion Prediction

Human Motion Prediction Based on Space-Time-Separable Graph Convolutional Network

Skeleton-Based Human Motion Prediction With Privileged Supervision

TrajectoryCNN: A New Spatio-Temporal Feature Learning Network for Human Motion Prediction

Efficient Human Motion Prediction Using Temporal Convolutional Generative Adversarial Network

Human Motion Prediction Via Dual-Attention and Multi-Granularity Temporal Convolutional Networks.