Abstract:Human-machine Interface (HMI) is critical for safety during automated driving, as it serves as the only media between the automated system and human users. To enable a transparent HMI, we first need to know how to evaluate it. However, most of the assessment methods used for HMI designs are subjective and thus not efficient. To bridge the gap, an objective and standardized HMI assessment method is needed, and the first step is to find an objective method for workload measurement for this context. In this study, two psychophysiological measures, electrocardiography (ECG) and electrodermal activity (EDA), were evaluated for their effectiveness in finding differences in mental workload among different HMI designs in a simulator study. Three HMI designs were developed and used. Results showed that both workload measures were able to identify significant differences in objective mental workload when interacting with in-vehicle HMIs. As a first step toward a standardized assessment method, the results could be used as a firm ground for future studies. Marie Skłodowska-Curie Actions; Innovative Training Network (ITN); SHAPE-IT; Grant number 860410; Publication date: [29 Sep 2023]; DOI: [<a class="link-https link-external" data-doi="10.54941/ahfe1004172" href="https://doi.org/10.54941/ahfe1004172" rel="external noopener nofollow">https://doi.org/10.54941/ahfe1004172</a>]

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: How to evaluate the impact of human - machine interface (HMI) design on drivers' mental workload in an automated driving system through objective methods. Specifically, the paper aims to explore the use of two physiological indicators, electrocardiogram (ECG) and electrodermal activity (EDA), to measure the differences in drivers' mental workload under different HMI designs, in the hope of establishing a more objective and standardized HMI evaluation method. ### Background and Motivation 1. **The Importance of HMI in Automated Driving Systems** - The human - machine interface (HMI) of an automated driving system (ADS) is a key component for ensuring driving safety because it is the only interactive medium between the automated system and human users. - Different levels of automation will lead to continuous changes in the roles and responsibilities of human users, so the design of HMI is crucial for achieving a safe and efficient transition. 2. **Limitations of Existing Evaluation Methods** - At present, most HMI evaluation methods mainly rely on subjective questionnaires, which are prone to bias and difficult to standardize. - There is a need for an objective and standardized HMI evaluation method to improve the accuracy and efficiency of evaluation. ### Research Objectives - **Evaluate the Effectiveness of Physiological Indicators**: By using two physiological indicators, electrocardiogram (ECG) and electrodermal activity (EDA), evaluate their effectiveness in identifying differences in mental workload under different HMI designs. - **Establish a Standardized Evaluation Method**: Based on the research results, propose a standardized HMI evaluation method that combines physiological indicators and transparency evaluation to improve the efficiency and reliability of HMI design. ### Methods - **Participants**: 24 participants were recruited, aged between 22 and 30 years old, all with valid driving licenses. - **HMI Design**: Three different SAE Level 2 HMI designs were developed, named Fog HMI, Trans HMI, and Trans - fog HMI respectively, and each design differs in terms of transparency and required cognitive load. - **Physiological Indicators**: - **Electrocardiogram (ECG)**: Record heart rate variability (HRV), especially the root mean square of successive differences (RMSSD). - **Electrodermal Activity (EDA)**: Record skin conductance response (SCR). - **Self - Reported Workload**: Use the NASA - TLX questionnaire and subjective transparency test as reference indicators. ### Results - **Results of Physiological Indicators**: - There are significant differences in RMSSD among the three HMI designs. The RMSSD of Trans HMI design is the highest, indicating that it has the lowest required cognitive load. - There are also significant differences in SCR among the three HMI designs. The SCR of Trans HMI design is the lowest, further confirming that it has the lowest required cognitive load. - **Results of Self - Reported Workload**: - The NASA - TLX scores and the results of the subjective transparency test are consistent with the results of physiological indicators. The Trans HMI design has the lowest subjective workload and the highest transparency. ### Discussion - **Effectiveness of Physiological Indicators**: The ECG and EDA indicators can effectively distinguish the differences in mental workload under different HMI designs, especially the RMSSD and SCR indicators. - **Standardized Evaluation Method**: Combining physiological indicators and transparency evaluation methods can establish a more objective and standardized HMI evaluation method, which is suitable for HMI design and evaluation in dynamic environments. ### Conclusions and Future Work - **Conclusions**: The research has confirmed the effectiveness of ECG and EDA indicators in evaluating the mental workload of HMI design, providing a solid foundation for the HMI evaluation process. - **Future Work**: The next step is to incorporate physiological indicators into the transparency evaluation method and develop an objective and standardized HMI evaluation method to improve the efficiency and reliability of HMI design.

Workload Assessment of Human-Machine Interface: A Simulator Study with Psychophysiological Measures

Human-Machine Interface Evaluation Using EEG in Driving Simulator

Physiological Indicators of Driver Workload During Car-Following Scenarios and Takeovers in Highly Automated Driving

Multiple Measures of Monitoring Mental Workload

Human Performance Measures for the Evaluation of Process Control Human-System Interfaces in High-Fidelity Simulations

Assessment of Mental Workload Based on Multi-Physiological Signals

Mental workload assessment by monitoring brain, heart, and eye with six biomedical modalities during six cognitive tasks

Mental workload recognition using ECG and machine learning in simulated flight tasks

The HADRIAN novel human–machine interface prototype for automated driving: safety and impact assessment

A Multi-disciplinary Assessments Tool for Human-Machine Interaction

Determining Cognitive Workload Using Physiological Measurements: Pupillometry and Heart-Rate Variability

Neurophysiological Assessment of An Innovative Maritime Safety System in Terms of Ship Operators’ Mental Workload, Stress, and Attention in the Full Mission Bridge Simulator

Human Mental Workload: A Survey and a Novel Inclusive Definition

The Effects of a Predictive HMI and Different Transition Frequencies on Acceptance, Workload, Usability, and Gaze Behavior during Urban Automated Driving

In-Vehicle Interface Adaptation to Environment-Induced Cognitive Workload

Workload Measurement Method for Manned Vehicles in Multitasking Environments

The effect of human-machine interface modality, specificity, and timing on driver performance and behavior while using vehicle automation

Workload Measurement Using Physiological and Activity Measures for Validation Test: A Case Study for the Main Control Room of a Nuclear Power Plant

EEG-Based Mental Workload Assessment in a Simulated Flight Task Using Single-Channel Brain Rhythm Sequence

Classification of Drivers’ Mental Workload Levels: Comparison of Machine Learning Methods Based on ECG and Infrared Thermal Signals

A Survey on Measuring Cognitive Workload in Human-Computer Interaction