Abstract:Wearable sensors such as Inertial Measurement Units (IMUs) are often used to assess the performance of human exercise. Common approaches use handcrafted features based on domain expertise or automatically extracted features using time series analysis. Multiple sensors are required to achieve high classification accuracy, which is not very practical. These sensors require calibration and synchronization and may lead to discomfort over longer time periods. Recent work utilizing computer vision techniques has shown similar performance using video, without the need for manual feature engineering, and avoiding some pitfalls such as sensor calibration and placement on the body. In this paper, we compare the performance of IMUs to a video-based approach for human exercise classification on two real-world datasets consisting of Military Press and Rowing exercises. We compare the performance using a single camera that captures video in the frontal view versus using 5 IMUs placed on different parts of the body. We observe that an approach based on a single camera can outperform a single IMU by 10 percentage points on average. Additionally, a minimum of 3 IMUs are required to outperform a single camera. We observe that working with the raw data using multivariate time series classifiers outperforms traditional approaches based on handcrafted or automatically extracted features. Finally, we show that an ensemble model combining the data from a single camera with a single IMU outperforms either data modality. Our work opens up new and more realistic avenues for this application, where a video captured using a readily available smartphone camera, combined with a single sensor, can be used for effective human exercise classification.

Deeper Exercise Monitoring for Smart Gym using Fused RFID and CV Data

Femo: A Platform For Free-Weight Exercise Monitoring With Rfids

Wearable IMU-based Gym Exercise Recognition Using Data Fusion Methods.

An Activity Management System for Office Workers Using Multimodal Data

A Platform for Free-Weight Exercise Monitoring with Passive Tags.

IFC: Your Invisible Fitness Coach Based on CSI Sensing

Device-free Personalized Fitness Assistant Using WiFi

ExerTrack—Towards Smart Surfaces to Track Exercises

FitAssist

Development of Wearable Devices for Collecting Digital Rehabilitation/Fitness Data from Lower Limbs

Wearable Sensor-based Physical Activity Intensity Recognition Using Deep Learning Feature Engineering Fusion

Machine Vision Based Physical Fitness Measurement with Human Posture Recognition and Skeletal Data Smoothing

Design of Human Activity Recognition Algorithms Based on a Single Wearable IMU Sensor.

ExerSense: Real-Tme Physical Exercise Segmentation, Classification, and Counting Algorithm Using an IMU Sensor

Wireless Aerobic Exercise Monitoring System Based on Multimodal Sensors

A Deep Learning Method for Complex Human Activity Recognition Using Virtual Wearable Sensors

A Triaxial Accelerometer-Based Human Activity Recognition Via EEMD-Based Features and Game-Theory-Based Feature Selection

RTagCare: Deep Human Activity Recognition Powered by Passive Computational RFID Sensors.

Towards Environment Independent Device Free Human Activity Recognition

An Improved Algorithm for Human Activity Recognition Using Wearable Sensors

An Examination of Wearable Sensors and Video Data Capture for Human Exercise Classification