Abstract:Driver drowsiness increases crash risk, leading to substantial road trauma each year. Drowsiness detection methods have received considerable attention, but few studies have investigated the implementation of a detection approach on a mobile phone. Phone applications reduce the need for specialised hardware and hence, enable a cost-effective roll-out of the technology across the driving population. While it has been shown that three-dimensional (3D) operations are more suitable for spatiotemporal feature learning, current methods for drowsiness detection commonly use frame-based, multi-step approaches. However, computationally expensive techniques that achieve superior results on action recognition benchmarks (e.g. 3D convolutions, optical flow extraction) create bottlenecks for real-time, safety-critical applications on mobile devices. Here, we show how depthwise separable 3D convolutions, combined with an early fusion of spatial and temporal information, can achieve a balance between high prediction accuracy and real-time inference requirements. In particular, increased accuracy is achieved when assessment requires motion information, for example, when sunglasses conceal the eyes. Further, a custom TensorFlow-based smartphone application shows the true impact of various approaches on inference times and demonstrates the effectiveness of real-time monitoring based on out-of-sample data to alert a drowsy driver. Our model is pre-trained on ImageNet and Kinetics and fine-tuned on a publicly available Driver Drowsiness Detection dataset. Fine-tuning on large naturalistic driving datasets could further improve accuracy to obtain robust in-vehicle performance. Overall, our research is a step towards practical deep learning applications, potentially preventing micro-sleeps and reducing road trauma.

Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System

Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network

EEG-based System Using Deep Learning and Attention Mechanism for Driver Drowsiness Detection

Heavy Truck Driver's Drowsiness Detection Method Using Wearable EEG Based on Convolution Neural Network

Recognizing drowsiness in young men during real driving based on electroencephalography using an end-to-end deep learning approach

Behind-the-Ear EEG-based Wearable Driver Drowsiness Detection System using Embedded Tiny Neural Networks

Real-time Driver Drowsiness Detection for Android Application Using Deep Neural Networks Techniques

EOG-based drowsiness detection using convolutional neural networks

Cell-phone based Drowsiness Monitoring and Management system

Driving Drowsiness Detection With Eeg Using A Modified Hierarchical Extreme Learning Machine Algorithm With Particle Swarm Optimization: A Pilot Study

EEG_DMNet: A Deep Multi-Scale Convolutional Neural Network for Electroencephalography-Based Driver Drowsiness Detection

Driver Drowsiness Detection Using EEG and EOG with an Attention-CNN Framework

Deep Learning-Based Attention Mechanism for Automatic Drowsiness Detection Using EEG Signal

Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks

An Android-Based Driver Drowsiness Monitoring System

A Compact and Interpretable Convolutional Neural Network for Cross-Subject Driver Drowsiness Detection from Single-Channel EEG

A Study on Drowsy Driving State Based on EEG Signals

DrowzEE-G-Mamba: Leveraging EEG and State Space Models for Driver Drowsiness Detection

EEG-Based Drowsiness Estimation for Driving Safety Using Deep Q-Learning

A Real-Time Embedded System for Driver Drowsiness Detection Based on Visual Analysis of the Eyes and Mouth Using Convolutional Neural Network and Mouth Aspect Ratio