Abstract:Background Monitoring of long-haul truck driver fatigue state has attracted considerable interest. Conventional fatigue driving detection methods based on the physiological and visual features are scarcely applicable, due to the intrusiveness, reliability, and cost-effectiveness concerns. Methods We elaborately developed a fatigue driving detection method by fusion of non-visual features derived from the customized wristbands, vehicle-mounted equipment, and trip logs. To capture the spatiotemporal information within the sequential data, the bidirectional long short-term memory network with attention mechanism was proposed to determine whether the truck driver was fatigued within a fine-grained episode of one minute. The model was validated using a natural driving dataset with nine truck drivers on real-world roads in Guiyang, China during June and July 2021. Results Our approach yielded 99.21 %, 84.44 %, 82.01 %, 99.63 %, and 83.21 % in accuracy, precision, recall, specificity, and F1-score, respectively. Compared with the mainstream visual-based methods, our approach outperformed particularly in terms of precision and recall. Photoplethysmogram stood out as the most important feature for truck driver fatigue state detection. Vehicle load, driving forward angle, cumulative driving time, midnight, and recent working hours were found to be positively associated with the probability of fatigue driving, while the galvanic skin response, vehicle acceleration, current time, and recent rest hours had a negative relationship. Specifically, truck drivers were more likely to fatigue when driving at 20–40 km/h, braking abruptly at 5–10 m/s 2 , with vehicle loads over 70 tons, and driving more than 100 min consecutively. Conclusions Our study is among the first to harness the natural driving dataset to delve into the real-life fatigue pattern of long-haul truck drivers without disruptions on routine driving tasks. The proposed method holds pragmatic prospects by providing a privacy-preserving, robust, real-time, and non-intrusive technical pathway for truck driver fatigue monitoring.

A Driving Fatigue Dataset of Driver's Facial Features and Heart Rate Features

Driver fatigue detection method based on multi-feature empirical fusion model

Vision-Based Fatigue Driving Recognition Method Integrating Heart Rate and Facial Features

A Fatigue Driving Detection Algorithm Based on Facial Multi-Feature Fusion

Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences

Research on Driver’s Fatigue Detection Based on Information Fusion

Fatigue Detection Based on Facial Feature Correction and Fusion

An fNIRS labeling image feature-based customized driving fatigue detection method

Real-Time Detection of Fatigue Driving Based on Face Recognition

Driver Emotion and Fatigue State Detection Based on Time Series Fusion

Real-time Monitoring of Driver Fatigue Based on Eye State Recognition

Fatigue Driving Detection Based on Deep Learning and Multi-Index Fusion

FMIF: facial multi-feature information fusion for driver fatigue detection

Fatigue at the wheel: A non-visual approach to truck driver fatigue detection by multi-feature fusion

Fatigue Driving Recognition Method Based on Multi-Scale Facial Landmark Detector

A Multimodal Fusion Fatigue Driving Detection Method Based on Heart Rate and PERCLOS

Driver fatigue detection based on deeply-learned facial expression representation

Driver fatigue detection method based on facial features using deep learning

A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination

Adaptive Driver Face Feature Fatigue Detection Algorithm Research

Real-time detection method of driver fatigue state based on deep learning of face video