Abstract:Accidents due to driver drowsiness are observed to be increasing at an alarming rate across all countries and it becomes necessary to identify driver drowsiness to reduce accident rates. Researchers handled many machine learning and deep learning techniques especially many CNN variants created for drowsiness detection, but it is dangerous to use in real time, as the design fails due to high computational complexity, low evaluation accuracies and low reliability. In this article, we introduce a multistage adaptive 3D-CNN model with multi-expressive features for Driver Drowsiness Detection (DDD) with special attention to system complexity and performance. The proposed architecture is divided into five cascaded stages: (1) A three level Convolutional Neural Network (CNN) for driver face positioning (2) 3D-CNN based Spatio-Temporal (ST) Learning to extract 3D features from face positioned stacked samples. (3) State Understanding (SU) to train 3D-CNN based drowsiness models (4) Feature fusion using ST and SU stages (5) Drowsiness Detection stage. The Proposed system extract ST values from the face positioned images and then merges it with SU results from each state understanding sub models to create conditional driver facial features for final Drowsiness Detection (DD) model. Final DD Model is trained offline and implemented in online, results show the developed model performs well when compared to others and additionally capable of handling Indian conditions. This method is applied (Trained and Evaluated) using two different datasets, Kongu Engineering College Driver Drowsiness Detection (KEC-DDD) own dataset and National Tsing Hua University Driver Drowsiness Detection (NTHU-DDD) Benchmark Dataset. The proposed system trained with KEC-DDD dataset produces accuracy of 77.45% and 75.91% using evaluation set of KEC-DDD and NTHU-DDD dataset and capable to detect driver drowsiness from 256×256 resolution images at 39.6 fps at an average of 400 execution seconds.

Robust Two-Stream Multi-Features Network for Driver Drowsiness Detection

Robust Two-Stream Multi-Feature Network for Driver Drowsiness Detection

Convolutional Two-Stream Network Using Multi-Facial Feature Fusion for Driver Fatigue Detection

A Real-Time Driving Drowsiness Detection Algorithm With Individual Differences Consideration

Two-Stream Spatial–Temporal Graph Convolutional Networks for Driver Drowsiness Detection

Long-term Multi-granularity Deep Framework for Driver Drowsiness Detection.

A multi-aware graph convolutional network for driver drowsiness detection

Face Positioned Driver Drowsiness Detection Using Multistage Adaptive 3D Convolutional Neural Network

Towards Drowsiness Driving Detection Based on Multi-Feature Fusion and LSTM Networks

Joint Shape And Local Appearance Features For Real-Time Driver Drowsiness Detection

Driver Drowsiness Recognition via 3D Conditional GAN and Two-Level Attention Bi-LSTM

MSTN: Multistage Spatial-Temporal Network for Driver Drowsiness Detection

A Multi-view Driver Drowsiness Detection Method Using Transfer Learning and Population-based Sampling Strategy

Tensor-Based EEG Network Formation and Feature Extraction for Cross-Session Driving Drowsiness Detection*

Driver Drowsiness Detection Based on ResNet-18 and Transfer Learning

Driving Fatigue Detection Based on the Combination of Multi-Branch 3D-CNN and Attention Mechanism

DrowsyDetectNet: Driver Drowsiness Detection Using Lightweight CNN With Limited Training Data

All in One Network for Driver Attention Monitoring

Video-Based Driver Drowsiness Detection With Optimised Utilization of Key Facial Features

Hierarchical HMMs on Eyes for Driver Drowsiness Detection

Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System