Abstract:In an intelligent driving environment, monitoring the physiological state of drivers is crucial for ensuring driving safety. This paper proposes a method for monitoring and analyzing driver physiological characteristics by combining electronic vehicle identification (EVI) with multimodal biometric recognition. The method aims to efficiently monitor the driver’s heart rate, breathing frequency, emotional state, and fatigue level, providing real-time feedback to intelligent driving systems to enhance driving safety. First, considering the precision, adaptability, and real-time capabilities of current physiological signal monitoring devices, an intelligent cushion integrating MEMSs (Micro-Electro-Mechanical Systems) and optical sensors is designed. This cushion collects heart rate and breathing frequency data in real time without disrupting the driver, while an electrodermal activity monitoring system captures electromyography data. The sensor layout is optimized to accommodate various driving postures, ensuring accurate data collection. The EVI system assigns a unique identifier to each vehicle, linking it to the physiological data of different drivers. By combining the driver physiological data with the vehicle’s operational environment data, a comprehensive multi-source data fusion system is established for a driving state evaluation. Secondly, a deep learning model is employed to analyze physiological signals, specifically combining Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks. The CNN extracts spatial features from the input signals, while the LSTM processes time-series data to capture the temporal characteristics. This combined model effectively identifies and analyzes the driver’s physiological state, enabling timely anomaly detection. The method was validated through real-vehicle tests involving multiple drivers, where extensive physiological and driving behavior data were collected. Experimental results show that the proposed method significantly enhances the accuracy and real-time performance of physiological state monitoring. These findings highlight the effectiveness of combining EVI with multimodal biometric recognition, offering a reliable means for assessing driver states in intelligent driving systems. Furthermore, the results emphasize the importance of personalizing adjustments based on individual driver differences for more effective monitoring.

Machine Learning Based Driver Emotion Monitoring for Vehicular IoT

Driver Emotion Recognition Involving Multimodal Signals: Electrophysiological Response, Nasal-Tip Temperature, and Vehicle Behavior

DriveSense: A Multi-modal Emotion Recognition and Regulation System for a Car Driver

Monitoring and Analyzing Driver Physiological States Based on Automotive Electronic Identification and Multimodal Biometric Recognition Methods

Driver Emotion and Fatigue State Detection Based on Time Series Fusion

A Multimodal Driver Emotion Recognition Algorithm Based on the Audio and Video Signals in Internet of Vehicles Platform

Emotion detection and face recognition of drivers in autonomous vehicles in IoT platform

Drivers' Comprehensive Emotion Recognition Based on HAM

Driving Drowsiness Detection With Eeg Using A Modified Hierarchical Extreme Learning Machine Algorithm With Particle Swarm Optimization: A Pilot Study

Brain-Inspired Driver Emotion Detection for Intelligent Cockpits Based on Real Driving Data

Driver Emotion Recognition with a Hybrid Attentional Multimodal Fusion Framework

Driver emotion recognition framework based on electrodermal activity measurements during simulated driving conditions

Real-time detection method of driver fatigue state based on deep learning of face video

A Novel Fatigue Driving State Recognition and Warning Method Based on EEG and EOG Signals

Improving automatic detection of driver fatigue and distraction using machine learning

Personnel Emotion Recognition Model for Internet of Vehicles Security Monitoring in Community Public Space.

CNN Based Subject-Independent Driver Emotion Recognition System Involving Physiological Signals for ADAS

Driver Status Monitoring System with Feedback from Fatigue Detection and Lane Line Detection

Recognition of the Driver's Unhealthy Facial Expression Based on Independent Component Analysis and Support Vector Machine

Cognitive Aspect of Emotion Estimation of a Driver

Advancing driver fatigue detection in diverse lighting conditions for assisted driving vehicles with enhanced facial recognition technologies