Abstract:Manufacturing workers face prolonged strenuous physical activities, impacting both financial aspects and their health due to work-related fatigue. Continuously monitoring physical fatigue and providing meaningful feedback is crucial to mitigating human and monetary losses in manufacturing workplaces. This study introduces a novel application of multimodal wearable sensors and machine learning techniques to quantify physical fatigue and tackle the challenges of real-time monitoring on the factory floor. Unlike past studies that view fatigue as a dichotomous variable, our central formulation revolves around the ability to predict multilevel fatigue, providing a more nuanced understanding of the subject's physical state. Our multimodal sensing framework is designed for continuous monitoring of vital signs, including heart rate, heart rate variability, skin temperature, and more, as well as locomotive signs by employing inertial motion units strategically placed at six locations on the upper body. This comprehensive sensor placement allows us to capture detailed data from both the torso and arms, surpassing the capabilities of single-point data collection methods. We developed an innovative asymmetric loss function for our machine learning model, which enhances prediction accuracy for numerical fatigue levels and supports real-time inference. We collected data on 43 subjects following an authentic manufacturing protocol and logged their self-reported fatigue. Based on the analysis, we provide insights into our multilevel fatigue monitoring system and discuss results from an in-the-wild evaluation of actual operators on the factory floor. This study demonstrates our system's practical applicability and contributes a valuable open-access database for future research.

A Data-Driven Fatigue Prediction using Recurrent Neural Networks

A Forecasting Framework for Predicting Perceived Fatigue: Using Time Series Methods to Forecast Ratings of Perceived Exertion with Features from Wearable Sensors

Physiological Signals Based Fatigue Prediction Model for Motion Sensing Games

Machine Learning Techniques for Motion Analysis of Fatigue from Manual Material Handling Operations Using 3D Motion Capture Data

Wearable network for multilevel physical fatigue prediction in manufacturing workers

Fatigue Load Prediction of Large Wind Turbine by Big Data and Deep Learning

Machine Learning Assisted Human Fatigue Detection, Monitoring, and Recovery: Review

Real-time forecasting of exercise-induced fatigue from wearable sensors

Assessing Fatigue with Multimodal Wearable Sensors and Machine Learning

Automated and Continuous Fatigue Monitoring in Construction Workers Using Forearm EMG and IMU Wearable Sensors and Recurrent Neural Network

Using Non-invasive Wearable Sensors to Estimate Perceived Fatigue Level in Manual Material Handling Tasks

Predicting Fatigue in Long Duration Mountain Events with a Single Sensor and Deep Learning Model

Prediction Method of Lower Limb Muscle Fatigue Based on Combining Random Forest and Gated Recurrent Unit Neural Network

Activity-Aware Deep Cognitive Fatigue Assessment using Wearables

Non-Stationary Vibration Fatigue Life Prediction of Automotive Components Based on Long Short-Term Memory Network

Deep Learning for Fatigue Estimation on the Basis of Multimodal Human-Machine Interactions

Research on Advanced Prediction of Major Equipment Fatigue Load Based on Deep Learning

Towards Automated Fatigue Assessment using Wearable Sensing and Mixed-Effects Models

Fatigue Detection for Human Aware Adaptation in Human-Robot Collaboration

A Study on Fatigue among Drivers with Machine Learning by Using CNN and SVM

Data-driven learning fatigue detection system: A multimodal fusion approach of ECG (electrocardiogram) and video signals