Abstract:Background Monitoring of long-haul truck driver fatigue state has attracted considerable interest. Conventional fatigue driving detection methods based on the physiological and visual features are scarcely applicable, due to the intrusiveness, reliability, and cost-effectiveness concerns. Methods We elaborately developed a fatigue driving detection method by fusion of non-visual features derived from the customized wristbands, vehicle-mounted equipment, and trip logs. To capture the spatiotemporal information within the sequential data, the bidirectional long short-term memory network with attention mechanism was proposed to determine whether the truck driver was fatigued within a fine-grained episode of one minute. The model was validated using a natural driving dataset with nine truck drivers on real-world roads in Guiyang, China during June and July 2021. Results Our approach yielded 99.21 %, 84.44 %, 82.01 %, 99.63 %, and 83.21 % in accuracy, precision, recall, specificity, and F1-score, respectively. Compared with the mainstream visual-based methods, our approach outperformed particularly in terms of precision and recall. Photoplethysmogram stood out as the most important feature for truck driver fatigue state detection. Vehicle load, driving forward angle, cumulative driving time, midnight, and recent working hours were found to be positively associated with the probability of fatigue driving, while the galvanic skin response, vehicle acceleration, current time, and recent rest hours had a negative relationship. Specifically, truck drivers were more likely to fatigue when driving at 20–40 km/h, braking abruptly at 5–10 m/s 2 , with vehicle loads over 70 tons, and driving more than 100 min consecutively. Conclusions Our study is among the first to harness the natural driving dataset to delve into the real-life fatigue pattern of long-haul truck drivers without disruptions on routine driving tasks. The proposed method holds pragmatic prospects by providing a privacy-preserving, robust, real-time, and non-intrusive technical pathway for truck driver fatigue monitoring.

An Improved Random Forest Algorithm-Based Fatigue Recognition with Multiphysical Feature

Vision-Based Fatigue Driving Recognition Method Integrating Heart Rate and Facial Features

A Fatigue Driving Detection Algorithm Based on Facial Multi-Feature Fusion

A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination

Fatigue Detection Based on Facial Feature Correction and Fusion

Fatigue Driving Recognition Method Based on Multi-Scale Facial Landmark Detector

An fNIRS labeling image feature-based customized driving fatigue detection method

A Multimodal Fusion Fatigue Driving Detection Method Based on Heart Rate and PERCLOS

Driver fatigue detection method based on multi-feature empirical fusion model

RF-DCM: Multi-Granularity Deep Convolutional Model Based on Feature Recalibration and Fusion for Driver Fatigue Detection

Adaptive Driver Face Feature Fatigue Detection Algorithm Research

Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences

Fatigue Driving Detection Based on Deep Learning and Multi-Index Fusion

Fatigue driving detection system based on Perclos algorithm optimization

Real-Time Detection of Fatigue Driving Based on Face Recognition

mmDrive: Fine-Grained Fatigue Driving Detection Using mmWave Radar

Remote Photoplethysmography and Motion Tracking Convolutional Neural Network with Bidirectional Long Short-Term Memory: Non-Invasive Fatigue Detection Method Based on Multi-Modal Fusion

A Novel Fatigue Driving State Recognition and Warning Method Based on EEG and EOG Signals

FMIF: facial multi-feature information fusion for driver fatigue detection

Fatigue at the wheel: A non-visual approach to truck driver fatigue detection by multi-feature fusion

Driver fatigue detection based on deeply-learned facial expression representation