Abstract:Compared to traditional dance, intangible cultural heritage dance often involves the isotropic extension of choreographic actions, utilizing both upper and lower limbs. This characteristic choreography style makes the remote joints lack interaction, consequently reducing accuracy in existing human motion prediction methods. Therefore, we propose a human motion prediction method based on the multi-scale hypergraph convolutional network of the intangible cultural heritage dance video. Firstly, this method inputs the 3D human posture sequence from intangible cultural heritage dance videos. The hypergraph is designed according to the synergistic relationship of the human joints in the intangible cultural heritage dance video, which is used to represent the spatial correlation of the 3D human posture. Then, a multi-scale hypergraph convolutional network is constructed, utilizing multi-scale transformation operators to segment the human skeleton into different scales. This network adopts a graph structure to represent the 3D human posture at different scales, which is then used by the single-scalar fusion operator to spatial features in the 3D human posture sequence are extracted by fusing the feature information of the hypergraph and the multi-scale graph. Finally, the Temporal Graph Transformer network is introduced to capture the temporal dependence among adjacent frames within the time domain. This facilitates the extraction of temporal features from the 3D human posture sequence, ultimately enabling the prediction of future 3D human posture sequences. Experiments show that we achieve the best performance in both short-term and long-term human motion prediction when compared to Motion-Mixer and Motion-Attention algorithms on Human3.6M and 3DPW datasets. In addition, ablation experiments show that our method can predict more precise 3D human pose sequences, even in the presence of isotropic extensions of upper and lower limbs in intangible cultural heritage dance videos. This approach effectively addresses the issue of missing segments in intangible cultural heritage dance videos.

Real-Time Dance Posture Tracking Method Based on Lightweight Network

Based on network probabilistic graph human pose segmentation algorithm

Pose Estimation for Swimmers in Video Surveillance

A Study of Dance Movement Capture and Posture Recognition Method Based on Vision Sensors

Improved Graph Convolutional Neural Network for Dance Tracking and Pose Estimation

AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training Assistance

Human Dance Posture Detection Based on Improved Mayfly Algorithm

Role of Human Body Posture Recognition Method Based on Wireless Network Kinect in Line Dance Aerobics and Gymnastics Training

Application of Posture Recognition Service System Based on Information Fusion Smart Sensor in Dance Training

Wearable Sensor-Based Motion Data Analysis and Dance Performance Using Images and Cloud Computing

Motion Capture for Sporting Events Based on Graph Convolutional Neural Networks and Single Target Pose Estimation Algorithms

Multi-person dance tiered posture recognition with cross progressive multi-resolution representation integration

Low-Budget Real-time Pose Estimation Method for Personal Physical Exercise Assistant

Visualization of movements in sports training based on multimedia information processing technology

Analyzing body changes of high-level dance movements through biological image visualization technology by convolutional neural network

Research on motion capture of dance training pose based on statistical analysis of mathematical similarity matching

Dual-channel cascade pose estimation network trained on infrared thermal image and groundtruth annotation for real-time gait measurement

Human Fall Detection Model with Lightweight Network and Tracking in Video

A real-time algorithm for weight training detection and correction

Human Motion Prediction Based on a Multi-Scale Hypergraph for Intangible Cultural Heritage Dance Videos

Human movement analysis for interactive dance