Abstract:Background Monitoring of long-haul truck driver fatigue state has attracted considerable interest. Conventional fatigue driving detection methods based on the physiological and visual features are scarcely applicable, due to the intrusiveness, reliability, and cost-effectiveness concerns. Methods We elaborately developed a fatigue driving detection method by fusion of non-visual features derived from the customized wristbands, vehicle-mounted equipment, and trip logs. To capture the spatiotemporal information within the sequential data, the bidirectional long short-term memory network with attention mechanism was proposed to determine whether the truck driver was fatigued within a fine-grained episode of one minute. The model was validated using a natural driving dataset with nine truck drivers on real-world roads in Guiyang, China during June and July 2021. Results Our approach yielded 99.21 %, 84.44 %, 82.01 %, 99.63 %, and 83.21 % in accuracy, precision, recall, specificity, and F1-score, respectively. Compared with the mainstream visual-based methods, our approach outperformed particularly in terms of precision and recall. Photoplethysmogram stood out as the most important feature for truck driver fatigue state detection. Vehicle load, driving forward angle, cumulative driving time, midnight, and recent working hours were found to be positively associated with the probability of fatigue driving, while the galvanic skin response, vehicle acceleration, current time, and recent rest hours had a negative relationship. Specifically, truck drivers were more likely to fatigue when driving at 20–40 km/h, braking abruptly at 5–10 m/s 2 , with vehicle loads over 70 tons, and driving more than 100 min consecutively. Conclusions Our study is among the first to harness the natural driving dataset to delve into the real-life fatigue pattern of long-haul truck drivers without disruptions on routine driving tasks. The proposed method holds pragmatic prospects by providing a privacy-preserving, robust, real-time, and non-intrusive technical pathway for truck driver fatigue monitoring.

Label-Less Learning for Urban Railway Transit Driver Fatigue Detection with Heart Rate Variability

Machine learning noise exposure detection of rail transit driver using heart rate variability

3 DCNN-based Real-time Driver Fatigue Behavior Detection in Urban Rail Transit

FedUSL: A Federated Annotation Method for Driving Fatigue Detection based on Multimodal Sensing Data

Driver Fatigue Detection Using Heart Rate Variability Features from 2-Minute Electrocardiogram Signals While Accounting for Sex Differences

A Driver Fatigue Detection Method Based On Multi-Sensor Signals

Real-time Monitoring and Early Warning Analysis of Urban Railway Operation Based on Multi-parameter Vital Signs of Subway Drivers in Plateau Environment

Train Driver Fatigue Detection Using Eye Feature Vector and Support Vector Machine

Improved LSTM-based Time-Series Anomaly Detection in Rail Transit Operation Environments

Data-driven learning fatigue detection system: A multimodal fusion approach of ECG (electrocardiogram) and video signals

A Simple Fatigue Condition Detection Method by using Heart Rate Variability Analysis

Driver Stress Detection Using Ultra-Short-Term HRV Analysis under Real World Driving Conditions

Fatigue at the wheel: A non-visual approach to truck driver fatigue detection by multi-feature fusion

Remote Photoplethysmography and Motion Tracking Convolutional Neural Network with Bidirectional Long Short-Term Memory: Non-Invasive Fatigue Detection Method Based on Multi-Modal Fusion

An iterative cross-subject negative-unlabeled learning algorithm for quantifying passive fatigue

An fNIRS labeling image feature-based customized driving fatigue detection method

A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination

Driver fatigue detection based on deeply-learned facial expression representation

Driver fatigue detection method based on multi-feature empirical fusion model

Driver Mental Fatigue Detection Based on Head Posture Using New Modified reLU-BiLSTM Deep Neural Network

A New Detecting and Tracking Method in Driver Fatigue Detection