Abstract:Human motion prediction is the key technology for many real-life applications, e.g., self-driving and human–robot interaction. The recent approaches adopt the unrestricted full-connection graph representation to capture the relationships inside the human skeleton. However, there are two issues to be solved: (i) these unrestricted full-connection graph representation methods neglect the inherent dependencies across the joints of the human body; (ii) these methods represent human motions using the features extracted from a single level and thus can neither fully exploit the various connection relationships among the human body nor guarantee the human motion prediction results to be reasonable. To tackle the above issues, we propose an adaptive multi-level hypergraph convolution network (AMHGCN), which uses the adaptive multi-level hypergraph representation to capture various dependencies among the human body. Our method has four different levels of hypergraph representations, including (i) the joint-level hypergraph representation to capture inherent kinetic dependencies in the human body, (ii) the part-level hypergraph representation to exploit the kinetic characteristics at a higher level (in comparison to the joint-level) by viewing some part of the human body as an entirety, (iii) the component-level hypergraph representation to model the semantic information, and (iv) the global-level hypergraph representation to extract long-distance dependencies in the human body. In addition, to take full advantage of the knowledge carried in the training data, we propose a reverse loss ( i.e., adopting the future human poses to predict the historical poses reversely) to realize data augmentation. Extensive experiments show that our proposed AMHGCN can achieve state-of-the-art performance on three benchmarks, i.e., Human3.6M, CMU-Mocap, and 3DPW.

Domain Transfer-Based Hypergraph Convolutional Network for Posture Anomaly Detection in Physical Education Teaching

Application of Human Posture Recognition Based on the Convolutional Neural Network in Physical Training Guidance

An Expert-Knowledge-Based Graph Convolutional Network for Skeleton- Based Physical Rehabilitation Exercises Assessment

Hybrid Directed Hypergraph Learning and Forecasting of Skeleton-Based Human Poses

Spatio-Temporal Pyramid Graph Convolutions for Human Action Recognition and Postural Assessment

Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos

Hypergraph Neural Network for Skeleton-Based Action Recognition

A novel approach for automatic detection and identification of inappropriate postures and movements of table tennis players

3D Human Pose Estimation Via Graph Extended Spatio-Temporal Convolutional Network

Human posture estimation and action recognition on fitness behavior and fitness

Research on Multiplayer Posture Estimation Technology of Sports Competition Video Based on Graph Neural Network Algorithm

HPGCN: Hierarchical Poselet-Guided Graph Convolutional Network for 3D Pose Estimation

HybridNet: Integrating GCN and CNN for skeleton-based action recognition

Graph Convolutional Networks for Assessment of Physical Rehabilitation Exercises

AMHGCN: Adaptive multi-level hypergraph convolution network for human motion prediction

Motion Capture for Sporting Events Based on Graph Convolutional Neural Networks and Single Target Pose Estimation Algorithms

Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition

GLA-GCN: Global-local Adaptive Graph Convolutional Network for 3D Human Pose Estimation from Monocular Video

Adaptive Hyper-Graph Convolution Network for Skeleton-based Human Action Recognition with Virtual Connections

Human Pose Prediction Using Interpretable Graph Convolutional Network for Smart Home

GTA-Net: An IoT-Integrated 3D Human Pose Estimation System for Real-Time Adolescent Sports Posture Correction