Abstract:In an intelligent driving environment, monitoring the physiological state of drivers is crucial for ensuring driving safety. This paper proposes a method for monitoring and analyzing driver physiological characteristics by combining electronic vehicle identification (EVI) with multimodal biometric recognition. The method aims to efficiently monitor the driver’s heart rate, breathing frequency, emotional state, and fatigue level, providing real-time feedback to intelligent driving systems to enhance driving safety. First, considering the precision, adaptability, and real-time capabilities of current physiological signal monitoring devices, an intelligent cushion integrating MEMSs (Micro-Electro-Mechanical Systems) and optical sensors is designed. This cushion collects heart rate and breathing frequency data in real time without disrupting the driver, while an electrodermal activity monitoring system captures electromyography data. The sensor layout is optimized to accommodate various driving postures, ensuring accurate data collection. The EVI system assigns a unique identifier to each vehicle, linking it to the physiological data of different drivers. By combining the driver physiological data with the vehicle’s operational environment data, a comprehensive multi-source data fusion system is established for a driving state evaluation. Secondly, a deep learning model is employed to analyze physiological signals, specifically combining Convolutional Neural Networks (CNNs) and Long Short-Term Memory (LSTM) networks. The CNN extracts spatial features from the input signals, while the LSTM processes time-series data to capture the temporal characteristics. This combined model effectively identifies and analyzes the driver’s physiological state, enabling timely anomaly detection. The method was validated through real-vehicle tests involving multiple drivers, where extensive physiological and driving behavior data were collected. Experimental results show that the proposed method significantly enhances the accuracy and real-time performance of physiological state monitoring. These findings highlight the effectiveness of combining EVI with multimodal biometric recognition, offering a reliable means for assessing driver states in intelligent driving systems. Furthermore, the results emphasize the importance of personalizing adjustments based on individual driver differences for more effective monitoring.

In-Vehicle Sensing for Smart Cars

Unobtrusive Health Monitoring in Private Spaces: The Smart Vehicle

Practical Sensing Techniques for Intelligent Vehicles

Advancements in the Intelligent Detection of Driver Fatigue and Distraction: A Comprehensive Review

In-Vehicle Information System and Driving Safety

Comprehensive Assessment of Artificial Intelligence Tools for Driver Monitoring and Analyzing Safety Critical Events in Vehicles

A review of sensory interactions between autonomous vehicles and drivers

Research Progress on the Development of Fatigue Driving Detection Based on Deep Learning

Towards In-Cabin Monitoring: A Preliminary Study on Sensors Data Collection and Analysis

A Survey of Driving Safety With Sensing, Vehicular Communications, and Artificial Intelligence-Based Collision Avoidance

Survey and synthesis of state of the art in driver monitoring

Situation Awareness Classification Using Multi-modal Sensing in Automated Driving

A Survey of Driving Fatigue Monitoring

A Survey on Vision-Based Driver Distraction Analysis.

Using Visual and Vehicular Sensors for Driver Behavior Analysis: A Survey

Wireless AI in Smart Car: How Smart a Car Can Be?

A Review on Fatigue Driving Detection

Monitoring and Analyzing Driver Physiological States Based on Automotive Electronic Identification and Multimodal Biometric Recognition Methods

Driver Modeling Based on Vehicular Sensing Data

Artificial Intelligence Methods in In-Cabin Use Cases: A Survey

Towards Robust Vehicular Context Sensing