Car-Driver Drowsiness Assessment through 1D Temporal Convolutional Networks

Francesco Rundo,Concetto Spampinato,Michael Rundo

2023-07-27

Abstract:Recently, the scientific progress of Advanced Driver Assistance System solutions (ADAS) has played a key role in enhancing the overall safety of driving. ADAS technology enables active control of vehicles to prevent potentially risky situations. An important aspect that researchers have focused on is the analysis of the driver attention level, as recent reports confirmed a rising number of accidents caused by drowsiness or lack of attentiveness. To address this issue, various studies have suggested monitoring the driver physiological state, as there exists a well-established connection between the Autonomic Nervous System (ANS) and the level of attention. For our study, we designed an innovative bio-sensor comprising near-infrared LED emitters and photo-detectors, specifically a Silicon PhotoMultiplier device. This allowed us to assess the driver physiological status by analyzing the associated PhotoPlethysmography (PPG) signal.Furthermore, we developed an embedded time-domain hyper-filtering technique in conjunction with a 1D Temporal Convolutional architecture that embdes a progressive dilation setup. This integrated system enables near real-time classification of driver drowsiness, yielding remarkable accuracy levels of approximately 96%.

Signal Processing,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address the issue of detecting driver fatigue. Specifically, the researchers designed an innovative biosensor system that evaluates the driver's physiological state through near-infrared LED emitters and photodetectors (particularly silicon photomultiplier devices) by analyzing the associated photoplethysmography (PPG) signals. Additionally, they developed an embedded time-domain ultrafiltration technique combined with a one-dimensional time convolution architecture with progressive dilation settings. This integrated system can classify the driver's fatigue state in near real-time, achieving a high accuracy of approximately 96%. The proposed method in the study avoids the issues encountered in traditional electrocardiogram (ECG) signal acquisition, such as motion artifacts and noise interference, requiring only a single contact point for accurate sampling. Moreover, this method does not require frequency domain analysis, and the data acquisition time is significantly reduced compared to traditional heart rate variability (HRV)-based methods. Experimental results show that the system performs excellently in the driver attention level classification task, with high accuracy and efficiency.

Car-Driver Drowsiness Assessment through 1D Temporal Convolutional Networks

Deep Learning Systems for Advanced Driving Assistance

Visual Saliency Detection in Advanced Driver Assistance Systems

Real-time monitoring of driver drowsiness on mobile platforms using 3D neural networks

Driver Drowsiness Detection by Applying Deep Learning Techniques to Sequences of Images

A Real-Time Embedded System for Driver Drowsiness Detection Based on Visual Analysis of the Eyes and Mouth Using Convolutional Neural Network and Mouth Aspect Ratio

A Real-Time Driving Drowsiness Detection Algorithm With Individual Differences Consideration

Driver Drowsiness Detection: A Machine Learning Approach on Skin Conductance

Driver Drowsiness Multi-Method Detection for Vehicles with Autonomous Driving Functions

A sophisticated Drowsiness Detection System via Deep Transfer Learning for real time scenarios

Processing and Integration of Multimodal Image Data Supporting the Detection of Behaviors Related to Reduced Concentration Level of Motor Vehicle Users

Enhancing Road Safety: Deep Learning-Based Intelligent Driver Drowsiness Detection for Advanced Driver-Assistance Systems

Automatic Driver Drowsiness Detection Using Artificial Neural Network Based on Visual Facial Descriptors: Pilot Study

Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System

VigilEye -- Artificial Intelligence-based Real-time Driver Drowsiness Detection

P10 - Optimizing the Design of a Multi-Sensor System for On-Line Driver State and Drowsiness Detection

Survey Paper for Real Time Car Driver Drowsiness Detection using Machine Learning Approach

Multimodal Driver Condition Monitoring System Operating in the Far-Infrared Spectrum

Towards In-Cabin Monitoring: A Preliminary Study on Sensors Data Collection and Analysis

Face Positioned Driver Drowsiness Detection Using Multistage Adaptive 3D Convolutional Neural Network

In-the-wild Drowsiness Detection from Facial Expressions