Abstract:Accidents due to driver drowsiness are observed to be increasing at an alarming rate across all countries and it becomes necessary to identify driver drowsiness to reduce accident rates. Researchers handled many machine learning and deep learning techniques especially many CNN variants created for drowsiness detection, but it is dangerous to use in real time, as the design fails due to high computational complexity, low evaluation accuracies and low reliability. In this article, we introduce a multistage adaptive 3D-CNN model with multi-expressive features for Driver Drowsiness Detection (DDD) with special attention to system complexity and performance. The proposed architecture is divided into five cascaded stages: (1) A three level Convolutional Neural Network (CNN) for driver face positioning (2) 3D-CNN based Spatio-Temporal (ST) Learning to extract 3D features from face positioned stacked samples. (3) State Understanding (SU) to train 3D-CNN based drowsiness models (4) Feature fusion using ST and SU stages (5) Drowsiness Detection stage. The Proposed system extract ST values from the face positioned images and then merges it with SU results from each state understanding sub models to create conditional driver facial features for final Drowsiness Detection (DD) model. Final DD Model is trained offline and implemented in online, results show the developed model performs well when compared to others and additionally capable of handling Indian conditions. This method is applied (Trained and Evaluated) using two different datasets, Kongu Engineering College Driver Drowsiness Detection (KEC-DDD) own dataset and National Tsing Hua University Driver Drowsiness Detection (NTHU-DDD) Benchmark Dataset. The proposed system trained with KEC-DDD dataset produces accuracy of 77.45% and 75.91% using evaluation set of KEC-DDD and NTHU-DDD dataset and capable to detect driver drowsiness from 256×256 resolution images at 39.6 fps at an average of 400 execution seconds.

Lightweight YOLOv8 Networks for Driver Profile Face Drowsiness Detection

Research on Fatigued-Driving Detection Method by Integrating Lightweight YOLOv5s and Facial 3D Keypoints

Real-time detection method of driver fatigue state based on deep learning of face video

Driver Drowsiness Detection by Using Front Camera of the Mobile Phone

DrowsyDetectNet: Driver Drowsiness Detection Using Lightweight CNN With Limited Training Data

Drowsiness Detection Based On Driver Temporal Behavior Using a New Developed Dataset

Face Positioned Driver Drowsiness Detection Using Multistage Adaptive 3D Convolutional Neural Network

Driver fatigue detection based on improved YOLOv7

Video-Based Driver Drowsiness Detection With Optimised Utilization of Key Facial Features

Robust Two-Stream Multi-Features Network for Driver Drowsiness Detection

A Real-Time Embedded System for Driver Drowsiness Detection Based on Visual Analysis of the Eyes and Mouth Using Convolutional Neural Network and Mouth Aspect Ratio

Driver Distracted Behavior Detection Technology with YOLO-Based Deep Learning Networks

Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks

Real-time Driver Drowsiness Detection for Android Application Using Deep Neural Networks Techniques

VigilEye -- Artificial Intelligence-based Real-time Driver Drowsiness Detection

Driver Drowsiness Recognition Based on Computer Vision Technology

Robust Two-Stream Multi-Feature Network for Driver Drowsiness Detection

Real-Time System for Driver Fatigue Detection by RGB-D Camera

Advancing driver fatigue detection in diverse lighting conditions for assisted driving vehicles with enhanced facial recognition technologies

Journey tracker: driver alerting system with a deep learning approach