Abstract:Recent technological advancements have spurred the usage of machine learning based applications in sports science and healthcare. Using wearable sensors and video cameras to analyze and improve the performance of athletes, has become widely popular. Physiotherapists, sports coaches and athletes actively look to incorporate the latest technologies in order to further improve performance and avoid injuries. While wearable sensors are very popular, their use is hindered by constraints on battery power and sensor calibration, especially for use cases which require multiple sensors to be placed on the body. Hence, there is renewed interest in video-based data capture and analysis for sports science. In this paper, we present the application of classifying strength and conditioning exercises using video. We focus on the popular Military Press exercise, where the execution is captured with a video-camera using a mobile device, such as a mobile phone, and the goal is to classify the execution into different types. Since video recordings need a lot of storage and computation, this use case requires data reduction, while preserving the classification accuracy and enabling fast prediction. To this end, we propose an approach named BodyMTS to turn video into time series by employing body pose tracking, followed by training and prediction using multivariate time series classifiers. We analyze the accuracy and robustness of BodyMTS and show that it is robust to different types of noise caused by either video quality or pose estimation factors. We compare BodyMTS to state-of-the-art deep learning methods which classify human activity directly from videos and show that BodyMTS achieves similar accuracy, but with reduced running time and model engineering effort. Finally, we discuss some of the practical aspects of employing BodyMTS in this application in terms of accuracy and robustness under reduced data quality and size. We show that BodyMTS achieves an average accuracy of 87%, which is significantly higher than the accuracy of human domain experts.

A Machine Learning Method for Identification of Key Body Poses in Cyclic Physical Exercises

Landmark-Based Methods for Temporal Alignment of Human Motions

Human motion segmentation using collaborative representations of 3D skeletal sequences.

The Identification Method for the Lower Limb Posture Based on the Identification and Trace of Image

A Human Activity Recognition System Based on Dynamic Clustering of Skeleton Data

Automatic human posture estimation for sport activity recognition with robust body parts detection and entropy markov model

Human Action Recognition Based on Kinematic Similarity in Real Time.

Analyzing Data Efficiency and Performance of Machine Learning Algorithms for Assessing Low Back Pain Physical Rehabilitation Exercises

Full-body Motion Capture for Multiple Closely Interacting Persons.

Physiotherapy Exercise Classification with Single-Camera Pose Detection and Machine Learning

Athletes' Action Recognition and Posture Estimation Algorithm Based on Image Processing Technology

Realtime Indoor Workout Analysis Using Machine Learning & Computer Vision

A marker-less human motion analysis system for motion-based biomarker identification and quantification in knee disorders

3D Human Activity Recognition Using Skeletal Data from RGBD Sensors.

Multiview Human Pose Estimation and Corrective Feedback

Study on Human Body Action Recognition.

Recognition and Scoring Physical Exercises via Temporal and Relative Analysis of Skeleton Nodes Extracted from the Kinect Sensor

Fast and robust video-based exercise classification via body pose tracking and scalable multivariate time series classifiers

Fitness Done Right: a Real-time Intelligent Personal Trainer for Exercise Correction

Intelligent Knee Sleeves: A Real-time Multimodal Dataset for 3D Lower Body Motion Estimation Using Smart Textile

Human posture estimation and action recognition on fitness behavior and fitness