Abstract:Sports physiotherapists and coaches are tasked with evaluating the movement quality of athletes across the spectrum of ability and experience. However, the accuracy of visual observation is low and existing technology outside of expensive lab-based solutions has limited adoption, leading to an unmet need for an efficient and accurate means to measure static and dynamic joint angles during movement, converted to movement metrics useable by practitioners. This paper proposes a set of pose landmarks for computing frequently used joint angles as metrics of interest to sports physiotherapists and coaches in assessing common strength-building human exercise movements. It then proposes a set of rules for computing these metrics for a range of common exercises (single and double drop jumps and counter-movement jumps, deadlifts and various squats) from anatomical key-points detected using video, and evaluates the accuracy of these using a published 3D human pose model trained with ground truth data derived from VICON motion capture of common rehabilitation exercises. Results show a set of mathematically defined metrics which are derived from the chosen pose landmarks, and which are sufficient to compute the metrics for each of the exercises under consideration. Comparison to ground truth data showed that root mean square angle errors were within 10° for all exercises for the following metrics: shin angle, knee varus/valgus and left/right flexion, hip flexion and pelvic tilt, trunk angle, spinal flexion lower/upper/mid and rib flare. Larger errors (though still all within 15°) were observed for shoulder flexion and ASIS asymmetry in some exercises, notably front squats and drop-jumps. In conclusion, the contribution of this paper is that a set of sufficient key-points and associated metrics for exercise assessment from 3D human pose have been uniquely defined. Further, we found generally very good accuracy of the Strided Transformer 3D pose model in predicting these metrics for the chosen set of exercises from a single mobile device camera, when trained on a suitable set of functional exercises recorded using a VICON motion capture system. Future assessment of generalization is needed.

Mining Automatically Estimated Poses from Video Recordings of Top Athletes

AI Coach: Deep Human Pose Estimation and Analysis for Personalized Athletic Training Assistance

Pose Estimation for Swimmers in Video Surveillance

Decoupling Video and Human Motion: Towards Practical Event Detection in Athlete Recordings

Monocular 3D Human Pose Estimation for Sports Broadcasts using Partial Sports Field Registration

Automatic Video-based Analysis of Athlete Action

Activity-conditioned continuous human pose estimation for performance analysis of athletes using the example of swimming

Deep Key Frame Extraction for Sport Training

Automatic Detection and Analysis of Player Action in Moving Background Sports Video Sequences

Single-Stage Pose Estimation and Joint Angle Extraction Method for Moving Human Body

Visualization of movements in sports training based on multimedia information processing technology

SportsPose -- A Dynamic 3D sports pose dataset

Motion Capture from Pan-Tilt Cameras with Unknown Orientation

ASPset: An outdoor sports pose video dataset with 3D keypoint annotations

Tracking Athletes in Diving Videos Based on Pose Learning

Self-Supervised Learning for Human Pose Estimation in Sports

Exercise quantification from single camera view markerless 3D pose estimation

Research on Multiplayer Posture Estimation Technology of Sports Competition Video Based on Graph Neural Network Algorithm

Motion Capture for Sporting Events Based on Graph Convolutional Neural Networks and Single Target Pose Estimation Algorithms

Extracting spatial knowledge from track and field broadcasts for monocular 3D human pose estimation

Observation and Analysis of High-Speed Human Motion with Frequent Occlusion in A Large Area