Fast Driver Distraction and Fatigue Detection Systems Based on Multiple Facial Behavior

Qiyuan Dai,Yi Fang,Fei Long,Yonghua Xu,Menglei Zhang,Song Wang,Jun Xu,Qiang Ling
DOI: https://doi.org/10.1109/ccdc55256.2022.10034198
2022-01-01
Abstract:Driver distraction and fatigue detection systems can effectively reduce car accidents and ensure the safety of traffic participants. Most of the existing vision-based approaches use facial landmarks as driver’s states. However, facial landmark detection is inaccurate under the large angle of head posture, which impacts the accuracy of further processing. This paper presents an effective method using convolution neural networks (CNNs). The method firstly deploys a modified MTCNN to detect the face region. Then, a lightweight multi-task CNN is proposed to detect eye regions, mouth landmarks and 3D head pose, and a simple CNN is used to detect eye closure independently. An angle-adapted loss function is applied to improve the landmark detection accuracy under the large posture. Finally, multiple abnormal behaviors are recognized to determine distraction and fatigue driving. Experiments show that our proposed method is superior to existing methods in both accuracy and running speed.
What problem does this paper attempt to address?