Abstract:Compared to traditional dance, intangible cultural heritage dance often involves the isotropic extension of choreographic actions, utilizing both upper and lower limbs. This characteristic choreography style makes the remote joints lack interaction, consequently reducing accuracy in existing human motion prediction methods. Therefore, we propose a human motion prediction method based on the multi-scale hypergraph convolutional network of the intangible cultural heritage dance video. Firstly, this method inputs the 3D human posture sequence from intangible cultural heritage dance videos. The hypergraph is designed according to the synergistic relationship of the human joints in the intangible cultural heritage dance video, which is used to represent the spatial correlation of the 3D human posture. Then, a multi-scale hypergraph convolutional network is constructed, utilizing multi-scale transformation operators to segment the human skeleton into different scales. This network adopts a graph structure to represent the 3D human posture at different scales, which is then used by the single-scalar fusion operator to spatial features in the 3D human posture sequence are extracted by fusing the feature information of the hypergraph and the multi-scale graph. Finally, the Temporal Graph Transformer network is introduced to capture the temporal dependence among adjacent frames within the time domain. This facilitates the extraction of temporal features from the 3D human posture sequence, ultimately enabling the prediction of future 3D human posture sequences. Experiments show that we achieve the best performance in both short-term and long-term human motion prediction when compared to Motion-Mixer and Motion-Attention algorithms on Human3.6M and 3DPW datasets. In addition, ablation experiments show that our method can predict more precise 3D human pose sequences, even in the presence of isotropic extensions of upper and lower limbs in intangible cultural heritage dance videos. This approach effectively addresses the issue of missing segments in intangible cultural heritage dance videos.

High-Quality Human Motion Prediction Using Size Invariant Motion Space

Forecasting Distillation: Enhancing 3D Human Motion Prediction with Guidance Regularization

Achieving view-distance and -angle invariance in motion prediction using a simple network

Toward Realistic 3D Human Motion Prediction with a Spatio-Temporal Cross- Transformer Approach

Towards Realistic 3D Human Motion Prediction with A Spatio-temporal Cross-transformer Approach

Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction

Multiscale Spatial and Temporal Learning for Human Motion Prediction

Motion Prediction Using Trajectory Cues

Learning Human Motion Prediction Via Stochastic Differential Equations

Multi-Scale Feature Extraction Model with Motion Attention for Human Motion Prediction

Long-Term Human Motion Prediction by Modeling Motion Context and Enhancing Motion Dynamic.

Class-guided Human Motion Prediction Via Multi-Spatial-temporal Supervision

Human Motion Prediction Using Manifold-Aware Wasserstein GAN

3D Skeleton-Based Human Motion Prediction Using Spatial–temporal Graph Convolutional Network

TrajectoryCNN: A New Spatio-Temporal Feature Learning Network for Human Motion Prediction

3D Skeleton-based Human Motion Prediction with Manifold-Aware GAN

Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction

Human Motion Prediction Based on a Multi-Scale Hypergraph for Intangible Cultural Heritage Dance Videos

Human Action Prediction Based On Skeleton Data

Towards Accurate 3D Human Motion Prediction from Incomplete Observations

Learning Progressive Joint Propagation for Human Motion Prediction