Abstract:In an intelligent driving environment, monitoring the physiological state of drivers is crucial for ensuring driving safety. This paper proposes a method for monitoring and analyzing driver physiological characteristics by combining electronic vehicle identification (EVI) with multimodal biometric recognition. The method aims to efficiently monitor the driver’s heart rate, breathing frequency, emotional state, and fatigue level, providing real-time feedback to intelligent driving systems to enhance driving safety. First, considering the precision, adaptability, and real-time capabilities of current physiological signal monitoring devices, an intelligent cushion integrating MEMSs (Micro-Electro-Mechanical Systems) and optical sensors is designed. This cushion collects heart rate and breathing frequency data in real time without disrupting the driver, while an electrodermal activity monitoring system captures electromyography data. The sensor layout is optimized to accommodate various driving postures, ensuring accurate data collection. The EVI system assigns a unique identifier to each vehicle, linking it to the physiological data of different drivers. By combining the driver physiological data with the vehicle’s operational environment data, a comprehensive multi-source data fusion system is established for a driving state evaluation. Secondly, a deep learning model is employed to analyze physiological signals, specifically combining Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks. The CNN extracts spatial features from the input signals, while the LSTM processes time-series data to capture the temporal characteristics. This combined model effectively identifies and analyzes the driver’s physiological state, enabling timely anomaly detection. The method was validated through real-vehicle tests involving multiple drivers, where extensive physiological and driving behavior data were collected. Experimental results show that the proposed method significantly enhances the accuracy and real-time performance of physiological state monitoring. These findings highlight the effectiveness of combining EVI with multimodal biometric recognition, offering a reliable means for assessing driver states in intelligent driving systems. Furthermore, the results emphasize the importance of personalizing adjustments based on individual driver differences for more effective monitoring.

An Ensemble Classification Model with Unsupervised Representation Learning for Driving Stress Recognition Using Physiological Signals

Detecting driving stress in physiological signals based on multimodal feature analysis and kernel classifiers

Driving Stress Detection Using Multimodal Convolutional Neural Networks with Nonlinear Representation of Short-Term Physiological Signals

Personalized Driver Stress Detection with Multi-task Neural Networks using Physiological Signals

Ensemble Classifier for Driver's Fatigue Detection Based on a Single EEG Channel

Driving Cognitive Alertness Detecting Using Evoked Multimodal Physiological Signals Based on Uncertain Self-Supervised Learning

Real-World Driver Stress Recognition and Diagnosis Based on Multimodal Deep Learning and Fuzzy EDAS Approaches

An aggressive driving state recognition model using EEG based on stacking ensemble learning

Regression Analysis of EEG Signals in Fatigue Driving Based on Ensemble Learning

Classification of Driver Cognitive Load in Conditionally Automated Driving: Utilizing Electrocardiogram-Based Spectrogram with Lightweight Neural Network

A Transductive Model-based Stress Recognition Method Using Peripheral Physiological Signals

Machine Learning Based Prediction of Future Stress Events in a Driving Scenario

Pilot Stress Detection Through Physiological Signals Using a Transformer-Based Deep Learning Model

Electroencephalogram-Based Driver Emotional State Detection with Manifold Learning

Recognition of Driver's Mental Workload Based on Physiological Signals, a Comparative Study.

A Hybrid Approach for Driving Behavior Recognition: Integration of CNN and Transformer-Encoder with EEG Data

A Hybrid EEG-Based Stress State Classification Model Using Multi-Domain Transfer Entropy and PCANet

Driver stress detection via multimodal fusion using attention-based CNN-LSTM

Driver Emotion Recognition Involving Multimodal Signals: Electrophysiological Response, Nasal-Tip Temperature, and Vehicle Behavior

Monitoring and Analyzing Driver Physiological States Based on Automotive Electronic Identification and Multimodal Biometric Recognition Methods

A Multilayer Stacking Method Base on RFE-SHAP Feature Selection Strategy for Recognition of Driver's Mental Load and Emotional State.