Abstract:Fatigue driving always endangers road traffic safety and is one of the main causes of traffic accidents. How to effectively monitor and determine the fatigue driving state, so as to realize the fatigue early warning, has become a hot spot of scientific research. The traditional detection methods are mostly based on a certain human physiological parameters, through the monitoring of the physiological parameters changes, to complete the determination of the fatigue state. Compared with the traditional detection methods, the fatigue detection method based on computer vision has the advantages of accurate and reliable detection results, detection not relying on wearable devices, and good human-computer interaction experience. However, in the specific algorithm application scenarios, there are often interference from environmental factors such as partial occlusion of the inspected image, low image resolution, complex illumination of the detection environment, and unstable acquisition equipment. In the face of many challenges, how to effectively improve the detection accuracy of fatigue state, and the algorithm has the practical application space, still needs to be explored. The traditional fatigue detection method based on facial information often detects and analyzes a certain subordination. Due to the detection of individual differences and the fuzzy definition of fatigue state, the algorithm has the problems of high recognition error rate and poor robustness. Moreover, the single attribute model separates the potential integration and exclusion relationship between facial attributes. At the same time, the huge model size and complex model structure also limit the actual implementation of the algorithm. In view of these urgent problems, this paper first proposes the fusion model of face detection and head posture analysis based on the multi-task convolutional neural network (MTCNN). The model uses the architecture strategy of multi-task cascade to complete the complete facial posture analysis task while completing the facial detection task. Secondly, based on the lightweight convolutional neural network (SqueezeNet) of the network cascade, the facial key point detection network is designed to obtain the 72-point key point coordinates of the face. For the obtained facial attribute information, extract fatigue features and propose a fatigue determination method of multimodal fusion. Finally, combined with the research results, the construction of the online fatigue detection and early warning system platform was completed.

Atlsmms Network: an Attentional-Bilstm Based Multi-Model Prediction for Smartphone Visual Fatigue

3‐3: Invited Paper: Prediction Model for Visual Fatigue Caused by Smartphone Display Based on EEG Multi‐dimensional Features

Physiological Signals Based Fatigue Prediction Model for Motion Sensing Games

Mental Fatigue Prediction Model Based on Multimodal Fusion

A novel deep-learning model based on τ-shaped convolutional network (τNet) with long short-term memory (LSTM) for physiological fatigue detection from EEG and EOG signals

EEG-Based Mental Fatigue Detection Using CNN-LSTM

EEG-Based 3D Visual Fatigue Evaluation Using CNN

Remote Photoplethysmography and Motion Tracking Convolutional Neural Network with Bidirectional Long Short-Term Memory: Non-Invasive Fatigue Detection Method Based on Multi-Modal Fusion

Spatial-Temporal Feature Representation Learning for Facial Fatigue Detection.

A Novel Temporal Adaptive Fuzzy Neural Network for Facial Feature Based Fatigue Assessment

LSTM Model with Self-Attention Mechanism for EEG Based Cross-Subject Fatigue Detection

EEG driving fatigue detection based on log-Mel spectrogram and convolutional recurrent neural networks

Mental fatigue recognition study based on 1D convolutional neural network and short-term ECG signals

sEMG-Based Neural Network Prediction Model Selection of Gesture Fatigue and Dataset Optimization

Data-driven learning fatigue detection system: A multimodal fusion approach of ECG (electrocardiogram) and video signals

Cognitive Load Prediction from Multimodal Physiological Signals Using Multiview Learning.

Attention-Guided Multi-scale Convolutional Neural Network for Driving Fatigue Detection

Intelligent fatigue detection based on hierarchical multi-scale ECG representations and HRV measures

Analysis and Study of Fatigue Driving Detection System based on Multimodal Fusion

A Generative Adaptive Convolutional Neural Network with Attention Mechanism for Driver Fatigue Detection with Class-imbalanced and Insufficient Data

An Explainable Student Fatigue Monitoring Module with Joint Facial Representation