Abstract:Operator attention failure due to mental fatigue during extended equipment operations is a common cause of equipment-related accidents that result in catastrophic injuries and fatalities. As a result, tracking operators' mental fatigue is critical to reducing equipment-related accidents on construction sites. Previously, several strategies aimed at recognizing mental fatigue with adequate accuracy, such as machine learning utilizing EEG-based wearable sensing systems, have been proposed. However, the ability to track operators' mental fatigue for its implementation on an actual construction site is still an issue. For instance, the mobility and systemic instability of EEG sensors necessitate their application in laboratory settings rather than on actual construction sites. Furthermore, while the machine learning classifiers achieved acceptable accuracy, their input is limited to manually developed EEG features, which may compromise the models' performance on real construction sites. Accordingly, the current research proposes the viability of a construction site strategy that uses flexible headband-based sensors for acquiring raw EEG data and deep learning networks to recognize operators' mental fatigue. To serve this purpose, a one-hour excavator operation by fifteen operators was conducted on a construction site. The NASA-TLX score was used as the ground truth of mental fatigue, and brain activity patterns were recorded using a wearable EEG sensor. The raw EEG data was then used to develop deep learning-based classification models. Finally, the performance of deep learning models, i.e., long short-term memory, bidirectional LSTM, and one-dimensional convolutional networks, was investigated using accuracy, precision, recall, specificity, and an F1-score. The findings indicate that the Bi-LSTM model outperforms the other deep learning models with a high accuracy of 99.941% and F1-score between 99.917% and 99.993%. These findings demonstrate the feasibility of applying the Bi-LSTM model and contribute to wearable sensor-based mental fatigue recognition and classification, thus enhancing on-site health and safety operations.

Identifying mental fatigue of construction workers using EEG and deep learning

Ubi-Fatigue: Toward Ubiquitous Fatigue Detection Via Contactless Sensing

Deep learning-based construction equipment operators' mental fatigue classification using wearable EEG sensor data

Pre-service Fatigue Screening for Construction Workers Through Wearable EEG-based Signal Spectral Analysis

Identification of mental fatigue in language comprehension tasks based on EEG and deep learning

Automated and Continuous Fatigue Monitoring in Construction Workers Using Forearm EMG and IMU Wearable Sensors and Recurrent Neural Network

Monitoring workers' attention and vigilance in construction activities through a wireless and wearable electroencephalography system

Pre-Service Fatigue Screening for Construction Labor Through Hybrid Kinematic-EEG Signal Processing and Workload Assessments

Internet of things and ensemble learning-based mental and physical fatigue monitoring for smart construction sites

Mental fatigue recognition study based on 1D convolutional neural network and short-term ECG signals

Mental workload recognition using ECG and machine learning in simulated flight tasks

Real-Time Monitoring of Mental Fatigue of Construction Workers Using Enhanced Sequential Learning and Timeliness

Non-invasive detection of mental fatigue in construction equipment operators through geometric measurements of facial features

Single-channel EEG-based mental fatigue detection based on deep belief network

Study on a Portable Electrode Used to Detect the Fatigue of Tower Crane Drivers in Real Construction Environment

Monitoring Fatigue in Construction Workers Using Wearable Sensors

Fatigue driving detection technology based on EEG signal

Identifying stable EEG patterns over time for mental workload recognition using transfer DS-CNN framework

Revealing the "invisible Gorilla" in Construction: Estimating Construction Safety Through Mental Workload Assessment

Assessment of mental fatigue using electroencephalography (EEG) and virtual reality (VR) for construction fall hazard prevention

Assessing Working Vulnerability of Construction Labor through EEG signal processing