Abstract:Human motion prediction is the key technology for many real-life applications, e.g., self-driving and human–robot interaction. The recent approaches adopt the unrestricted full-connection graph representation to capture the relationships inside the human skeleton. However, there are two issues to be solved: (i) these unrestricted full-connection graph representation methods neglect the inherent dependencies across the joints of the human body; (ii) these methods represent human motions using the features extracted from a single level and thus can neither fully exploit the various connection relationships among the human body nor guarantee the human motion prediction results to be reasonable. To tackle the above issues, we propose an adaptive multi-level hypergraph convolution network (AMHGCN), which uses the adaptive multi-level hypergraph representation to capture various dependencies among the human body. Our method has four different levels of hypergraph representations, including (i) the joint-level hypergraph representation to capture inherent kinetic dependencies in the human body, (ii) the part-level hypergraph representation to exploit the kinetic characteristics at a higher level (in comparison to the joint-level) by viewing some part of the human body as an entirety, (iii) the component-level hypergraph representation to model the semantic information, and (iv) the global-level hypergraph representation to extract long-distance dependencies in the human body. In addition, to take full advantage of the knowledge carried in the training data, we propose a reverse loss ( i.e., adopting the future human poses to predict the historical poses reversely) to realize data augmentation. Extensive experiments show that our proposed AMHGCN can achieve state-of-the-art performance on three benchmarks, i.e., Human3.6M, CMU-Mocap, and 3DPW.

Adaptive Hypergraph Neural Network for Multi-Person Pose Estimation

Semi-Dynamic Hypergraph Neural Network for 3D Pose Estimation

AdaptivePose: Human Parts As Adaptive Points

AdaptivePose++: A Powerful Single-Stage Network for Multi-Person Pose Regression

Multi-Scale Adaptive Structure Network For Human Pose Estimation From Color Images

YOLO-based GNN for Multi-Person Pose Estimation

A Compact and Powerful Single-Stage Network for Multi-Person Pose Estimation

HKE-GCN: Heatmaps-guided Keypoints Encoder and Graph Convolutional Network for Human Pose Estimation

Hierarchical Graph Neural Network for Human Pose Estimation

MSPENet: Multi-Scale Adaptive Fusion and Position Enhancement Network for Human Pose Estimation

Multi-person Pose Estimation Based on Graph Grouping Optimization

Multi-level Prediction with Graphical Model for Human Pose Estimation.

AMHGCN: Adaptive multi-level hypergraph convolution network for human motion prediction

Human Pose Estimation Based on Lightweight Multi-Scale Coordinate Attention

Hierarchical Graph Networks for 3D Human Pose Estimation

MPA-GNet: Multi-Scale Parallel Adaptive Graph Network for 3D Human Pose Estimation

MSMB-GCN: Multi-scale Multi-branch Fusion Graph Convolutional Networks for 3D Human Pose Estimation

A Multi-Level Network for Human Pose Estimation

Multi-Stage HRNet: Multiple Stage High-Resolution Network for Human Pose Estimation

Research on Multi-level Attention-based Human Pose Estimation

InsPose: Instance-Aware Networks for Single-Stage Multi-Person Pose Estimation