Abstract:The detection and prevention of workers’ body straining postures and other stressing conditions within the work environment, supports establishing occupational safety and promoting well being and sustainability at work. Developed methods towards this aim typically rely on combining highly ergonomic workplaces and expensive monitoring mechanisms including wearable devices. In this work, we demonstrate how the input from low-cost sensors, specifically, passive camera sensors installed in a real manufacturing workplace, and smartwatches used by the workers can provide useful feedback on the workers’ conditions and can yield key indicators for the prevention of work-related musculo-skeletal disorders (WMSD) and physical fatigue. To this end, we study the ability to assess the risk for physical strain of workers online during work activities based on the classification of ergonomically sub-optimal working postures using visual information, the correlation and fusion of these estimations with synchronous worker heart rate data, as well as the prediction of near-future heart rate using deep learning-based techniques. Moreover, a new multi-modal dataset of video and heart rate data captured in a real manufacturing workplace during car door assembly activities is introduced. The experimental results show the efficiency of the proposed approach that exceeds 70% of classification rate based on the F1 score measure using a set of over 300 annotated video clips of real line workers during work activities. In addition a time lagging correlation between the estimated ergonomic risks for physical strain and high heart rate was assessed using a larger dataset of synchronous visual and heart rate data sequences. The statistical analysis revealed that imposing increased strain to body parts will results in an increase to the heart rate after 100–120 s. This finding is used to improve the short term forecasting of worker’s cardiovascular activity for the next 10 to 30 s by fusing the heart rate data with the estimated ergonomic risks for physical strain and ultimately to train better predictive models for worker fatigue.

Wearable network for multilevel physical fatigue prediction in manufacturing workers

Ubi-Fatigue: Toward Ubiquitous Fatigue Detection Via Contactless Sensing

A Forecasting Framework for Predicting Perceived Fatigue: Using Time Series Methods to Forecast Ratings of Perceived Exertion with Features from Wearable Sensors

Assessing Fatigue with Multimodal Wearable Sensors and Machine Learning

Physiological Signals Based Fatigue Prediction Model for Motion Sensing Games

Using Non-invasive Wearable Sensors to Estimate Perceived Fatigue Level in Manual Material Handling Tasks

Automated and Continuous Fatigue Monitoring in Construction Workers Using Forearm EMG and IMU Wearable Sensors and Recurrent Neural Network

Continuous Measurement of Muscle Fatigue Using Wearable Sensors During Light Manual Operations.

Classifying Tasks Performed by Electrical Line Workers Using a Wrist-Worn Sensor: A Data Analytic Approach

Fatigue Monitoring in Running Using Flexible Textile Wearable Sensors

Detection of Physical Strain and Fatigue in Industrial Environments Using Visual and Non-Visual Low-Cost Sensors

Investigating Wearable Technology for Fatigue Identification in the Workplace

Mental fatigue detection using a wearable commodity device and machine learning

A Data Analytic End-to-end Framework for the Automated Quantification of Ergonomic Risk Factors Across Multiple Tasks Using a Single Wearable Sensor

Monitoring Fatigue in Construction Workers Using Wearable Sensors

Towards Automated Fatigue Assessment using Wearable Sensing and Mixed-Effects Models

Internet of things and ensemble learning-based mental and physical fatigue monitoring for smart construction sites

MBioTracker: Multimodal Self-Aware Bio-Monitoring Wearable System for Online Workload Detection

Deep Learning for Fatigue Estimation on the Basis of Multimodal Human-Machine Interactions

Worker Activity Recognition in Manufacturing Line Using Near-body Electric Field

Wearable heart rate sensing and critical power-based whole-body fatigue monitoring in the field