Effect of human–machine interface infotainment systems and automated vehicles on driver distraction

Elahe Abbasi,Yueqing Li,Yi Liu,Ruobing Zhao

DOI: https://doi.org/10.1002/hfm.21049

2024-09-04

Human Factors and Ergonomics in Manufacturing & Service Industries

Abstract:Human Factors and Ergonomics in Manufacturing &Service Industries, EarlyView.

engineering, manufacturing,ergonomics

What problem does this paper attempt to address?

Discovering the Power of External Human-Machine Interface: an EEG Study on the Driving Anger Regulation

Kejun Zhang,Xuan Duan,Lekai Zhang,Jiahang Yu,Yunhan Xu,Kailun He,Fo Hu

DOI: https://doi.org/10.1080/10447318.2024.2402118

IF: 4.92

2024-01-01

International Journal of Human-Computer Interaction

Abstract:Driving with anger can result in hazardous driving behaviors, often arising from inadequate communication among Traffic Participants (TPs). Currently, external Human-Machine Interface (eHMI) technology provides a novel channel for enhancing communication among TPs, yet its role in regulating driving emotions remains uncertain. This study investigates the impact of eHMI technology on the regulation of driving anger. We simulated a driving scenario in which the preceding vehicle abruptly applied brakes to elicit anger from the following driver. Three eHMI formats (Symbol, Text, and Symbol + Text) positioned at the rear of the preceding vehicle were implemented to explain the sudden braking event and regulate drivers' emotions. Objective electroencephalogram (EEG) signals and subjective assessment data were analyzed to assess the effects of eHMIs on driving anger regulation. The results indicate that driving with eHMIs exhibited significant regulatory quality of drivers' anger. Among the three formats, Symbol + Text eHMI exerted a notable regulatory impact, while both Symbol and Text eHMI contributed to emotional regulation. This study illustrates the positive impact of eHMI on emotion regulation in traffic environments, providing valuable backing for traffic management authorities in developing guidelines and policies, and contributing to the standardization of future eHMI technologies.
The effect of in‐vehicle agent embodiment on drivers' perceived usability and cognitive workload: Evidence from subjective reporting, ECG, and fNIRS

Zenggen Ren,Fu Guo,Mingming Li,Wei Lyu,Vincent G. Duffy

DOI: https://doi.org/10.1002/hfm.21030

2024-02-21

Human Factors and Ergonomics in Manufacturing & Service Industries

Abstract:Human Factors and Ergonomics in Manufacturing &Service Industries, EarlyView.

engineering, manufacturing,ergonomics
Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

Zhibin Zhou,Yitao Fan,Wenan Li,Hao Jiang,Weitao You,Lingyun Sun

DOI: https://doi.org/10.1080/10447318.2024.2381895

IF: 4.92

2024-01-01

International Journal of Human-Computer Interaction

Abstract:The interaction between autonomous vehicles (AVs) and pedestrians has gained significant attention, leading to the exploration of external human-machine interfaces (eHMIs) equipped on AVs to facilitate effective communication. While existing research suggests that perceptions of vehicle appearances may influence interactions between pedestrians and AVs, a comprehensive study on the eHMIs related to AV appearance remains lacking. Therefore, we conducted a virtual reality (VR) experiment to investigate how AV appearances affect pedestrians' acceptance regarding Awareness, Intent, and Harmony during interactions with various eHMIs. Leveraging the fuzzy set qualitative comparative analysis (fsQCA) method, we identified specific combinations of AV appearances and eHMIs that yield either high or low-performance interactions. For example, our findings reveal that text displays exhibit high performance in terms of awareness on AVs that are aggressive and ordinary. Furthermore, we distilled design guidelines to provide actionable suggestions for the design of eHMIs, fostering the acceptance of AVs among pedestrians.
Effects of Various In-Vehicle Human-Machine Interfaces on Drivers' Takeover Performance and Gaze Pattern in Conditionally Automated Vehicles

Jinlei Shi,Chunlei Chai,Ruiyi Cai,Haoran Wei,Youcheng Zhou,Hao Fan,Wei Zhang,Natasha Merat

DOI: https://doi.org/10.1016/j.ijhcs.2024.103362

IF: 4.866

2024-01-01

International Journal of Human-Computer Studies

Abstract:With the era of automated driving approaching, designing an effective and suitable human-machine interface (HMI) to present takeover requests (TORs) is critical to ensure driving safety. The present study conducted a simulated driving experiment to explore the effects of three HMIs (instrument panel, head-up display [HUD], and peripheral HMI) on takeover performance, simultaneously considering the TOR type (informative and generic TORs). Drivers' eye movement data were also collected to investigate how drivers distribute their attention between the HMI and surrounding environment during the takeover process. The results showed that using the peripheral HMI to present TORs can shorten takeover time, and drivers rated this HMI as more useful and satisfactory than conventional HMIs (instrument panel and HUD). Eye movement analysis revealed that the peripheral HMI encourages drivers to spend more time gazing at the road ahead and less time gazing at the TOR information than the instrument panel and HUD, indicating a better gaze pattern for traffic safety. The HUD seemed to have a risk of capturing drivers' attention, which resulted in an 'attention tunnel,' compared to the instrument panel. In addition, informative TORs were associated with better takeover performance and prompted drivers to spend less time gazing at rear-view mirrors than generic TORs. The findings of the present study can provide insights into the design and implementation of in-vehicle HMIs to improve the driving safety of automated vehicles.
Assessing driver distraction from in-vehicle information system: an on-road study exploring the effects of input modalities and secondary task types

Qi Zhong,Jinyi Zhi,Yongsheng Xu,Pengfei Gao,Shu Feng

DOI: https://doi.org/10.1038/s41598-024-71226-4

2024-08-31

Abstract:In-vehicle information system (IVIS) use is prevalent among young adults. However, their interaction with IVIS needs to be better understood. Therefore, an on-road study aims to explore the effects of input modalities and secondary task types on young drivers' secondary task performance, driving performance, and visual glance behavior. A 2 × 4 within-subject design was undertaken. The independent variables are input modalities (auditory-speech and visual-manual) and secondary task types (calls, music, navigation, and radio). The dependent variables include secondary task performance (task completion time, number of errors, and SUS), driving performance (average speed, number of lane departure warnings, and NASA-TLX), and visual glance behavior (average glance duration, number of glances, total glance duration, and number of glances over 1.6 s). The statistical analysis result showed that the main effect of input modalities is significant, with more distraction during visual-manual than auditory-speech. The main impact of secondary task types was also substantial across most metrics, aside from average speed and average glance duration. Navigation and music were the most distracting, followed by calls, and radio came in last. The distracting effect of input modalities is relatively stable and generally not moderated by the secondary task types, except radio tasks. The findings practically benefit the driver-friendly human-machine interface design, preventing IVIS-related distraction.
In-Vehicle Interface Adaptation to Environment-Induced Cognitive Workload

Elena Meiser,Alexandra Alles,Samuel Selter,Marco Molz,Amr Gomaa,Guillermo Reyes

DOI: https://doi.org/10.1145/3544999.3552533

2022-10-20

Abstract:Many car accidents are caused by human distractions, including cognitive distractions. In-vehicle human-machine interfaces (HMIs) have evolved throughout the years, providing more and more functions. Interaction with the HMIs can, however, also lead to further distractions and, as a consequence, accidents. To tackle this problem, we propose using adaptive HMIs that change according to the mental workload of the driver. In this work, we present the current status as well as preliminary results of a user study using naturalistic secondary tasks while driving (i.e., the primary task) that attempt to understand the effects of one such interface.

Human-Computer Interaction,Artificial Intelligence
Evaluation of Gesture-Based In-Vehicle Interaction: User Experience and the Potential to Reduce Driver Distraction

Lisa Graichen,Matthias Graichen,Josef F. Krems

DOI: https://doi.org/10.1177/0018720818824253

2019-01-29

Abstract:Objective: We observe the effects of in-vehicle system gesture-based interaction versus touch-based interaction on driver distraction and user experience. Background: Driver distraction is a major problem for traffic safety, as it is a contributing factor to a number of accidents. Visual distraction in particular has a highly negative impact on the driver. One possibility for reducing visual driver distraction is to use new forms of interaction in the vehicle, such as gesture-based interaction. Method: In this experiment, participants drove on a motorway or in a city scenario while using touch-based interaction or gesture-based interaction. Subjective data, such as acceptance and workload, and objective data, including glance behavior, were gathered. Results: As a result, participants rated their subjective impressions of safe driving as higher when using gesture-based interaction. More specifically, acceptance and attractiveness were higher, and workload was lower. The participants performed significantly fewer glances to the display and the glances were much shorter. Conclusion: Gestures are a positive alternative for in-vehicle interaction since effects on driver distraction are less significant when compared to touch-based interaction. Application: Potential application of this research includes interaction design of typical in-vehicle information and entertainment functions.
The effect of human-machine interface modality, specificity, and timing on driver performance and behavior while using vehicle automation

Meng Wang,Jah'inaya Parker,Nicholas Wong,Shashank Mehrotra,Shannon C. Roberts,Woon Kim,Alicia Romo,William J. Horrey

DOI: https://doi.org/10.1016/j.aap.2024.107606

IF: 5.9

2024-05-12

Accident Analysis & Prevention

Abstract:The effectiveness of the human–machine interface (HMI) in a driving automation system during takeover situations is based, in part, on its design. Past research has indicated that modality, specificity, and timing of the HMI have an impact on driver behavior. The objective of this study was to examine the effectiveness of two HMIs, which vary by modality, specificity, and timing, on drivers' takeover time, performance, and eye glance behavior. Drivers' behavior was examined in a driving simulator study with different levels of automation, varying traffic conditions, and while completing a non-driving related task. Results indicated that HMI type had a statistically significant effect on velocity and off-road eye glances such that those who were exposed to an HMI that gave multimodal warnings with greater specificity exhibited better performance. There were no effects of HMI on acceleration, lane position, or other eye glance metrics (e.g., on road glance duration). Future work should disentangle HMI design further to determine exactly which aspects of design yield between safety critical behavior.

public, environmental & occupational health,transportation,ergonomics,social sciences, interdisciplinary
Evaluation of Three In-Vehicle Interactions from Drivers' Driving Performance and Eye Movement Behavior.

Guofa Li,Fangping Zhu,Tingru Zhang,Ying Wang,Shengfan He,Xingda Qu

DOI: https://doi.org/10.1109/itsc.2018.8569917

2018-01-01

Abstract:Although in-vehicle interaction technologies offer assistances for drivers from multi-aspects, the distractions that may cause by these technologies would significantly challenge driving safety. This study examined the influences of three in-vehicle interactions on drivers' driving performance and eye movement behavior. The three in-vehicle interactions include phone pick-up (PPU), Bluetooth and audio (BT+AUD) and Bluetooth and head-up display (BT+HUD). A control group (i.e., None, in which no human-machine interaction was included while driving) was designed to highlight the influences of the examined interactions. Fourteen licensed drivers participated in the simulation experiments. Their age ranged from 20 to 30 years old (Mean±SD=25.1±3.8). They were required to complete the Location Based Service (LBS) tasks using the three interactions while driving. Both driving performance and eye movement data were collected for analysis. Results showed that, when using PPU or BT+HUD, the minimum throttle opening, the steering wheel angle (SWA) and the Shannon entropy (SE) of SWA were all greater than those values when using BT+AUD or None. As for the SE of throttle opening and all the examined eye movement features (frequency and duration of fixation/saccade), the values when using BT+AUD or BT+HUD were higher than the values when using PPU or None. The presented results in this study provide evidences for car manufactures to design better BT +AUD human-machine interaction systems as a priority strategy.
Advancements in the Intelligent Detection of Driver Fatigue and Distraction: A Comprehensive Review

Shichen Fu,Zhenfeng Li,Le Xu,Zhenhua Yang,Huixing Zhou,Yuan Ma

DOI: https://doi.org/10.3390/app14073016

2024-04-03

Applied Sciences

Abstract:Detecting the factors affecting drivers’ safe driving and taking early warning measures can effectively reduce the probability of automobile safety accidents and improve vehicle driving safety. Considering the two factors of driver fatigue and distraction state, their influences on driver behavior are elaborated from both experimental data and an accident library analysis. Starting from three modes and six types, intelligent detection methods for driver fatigue and distraction detection from the past five years are reviewed in detail. Considering its wide range of applications, the research on machine vision detection based on facial features in the past five years is analyzed, and the methods are carefully classified and compared according to their innovation points. Further, three safety warning and response schemes are proposed in light of the development of autonomous driving and intelligent cockpit technology. Finally, the paper summarizes the current state of research in the field, presents five conclusions, and discusses future trends.

Computer Science,Engineering
Impact of HMI on driver’s distraction on a freeway under heavy foggy condition based on visual characteristics

Dunli Hu,Xiaofan Feng,Xiaohua Zhao,Haijian Li,Jianming Ma,Qiang Fu

DOI: https://doi.org/10.1080/19439962.2020.1853641

2020-12-09

Abstract:<span>Connected vehicle technology relying on Human Machine Interface (HMI) achieve a dominant position in the overall safety improvement. However, the impact of HMI on the driver's visual attention cannot be ignored, especially on the accident-prone foggy freeway. The objective of this paper is to evaluate the level of distraction caused by HMI in data analysis of drivers' visual characteristics and to establish a generic evaluation methodology. A connected vehicle test platform has been established based on the driving simulator, in which visibility was set to the level of heavy fog and the technical condition was set in two conditions (with or without HMI). Measurement of driving behavior parameters include frequency of fixations and saccades and the proportion of fixation. The researchers compared and analyzed the driver's visual characteristics and the degree of distraction in a combination of indices based on the AttenD algorithm, setting two technical conditions in a heavy fog. Drivers suffering more visual distraction and interference with HMI may have an impact on the driver's driving safety. The results provide a generic approach to evaluate the HMI of a connected vehicle system and a safety assessment methodology for the connected vehicle system.</span>

transportation
Quantifying the Remote Driver's Interaction with 5G-Enabled Level 4 Automated Vehicles: A Real-World Study

Shuo Li,Yanghanzi Zhang,Simon Edwards,Phil Blythe

DOI: https://doi.org/10.3390/electronics13224366

IF: 2.9

2024-11-08

Electronics

Abstract:This real-world investigation aimed to quantify the human–machine interaction between remote drivers of teleoperation systems and the Level 4 automated vehicle in a real-world setting. The primary goal was to investigate the effects of disengagement and distraction on remote driver performance and behaviour. Key findings revealed that mental disengagement, achieved through distraction via a reading task, significantly slowed the remote driver's reaction time by an average of 5.309 s when the Level 4 automated system required intervention. Similarly, disengagement resulted in a 4.232 s delay in decision-making time for remote drivers when they needed to step in and make critical strategic decisions. Moreover, mental disengagement affected the remote drivers' attention focus on the road and increased their cognitive workload compared to constant monitoring. Furthermore, when actively controlling the vehicle remotely, drivers experienced a higher cognitive workload than in both "monitoring" and "disengagement" conditions. The findings emphasize the importance of designing teleoperation systems that keep remote drivers actively engaged with their environment, minimise distractions, and reduce disengagement. Such designs are essential for enhancing safety and effectiveness in remote driving scenarios, ultimately supporting the successful deployment of Level 4 automated vehicles in real-world applications.

engineering, electrical & electronic,computer science, information systems,physics, applied
In-Vehicle Information System and Driving Safety

WANG Ying,ZHANG Wei,WU Su

DOI: https://doi.org/10.3321/j.issn:1000-7857.2009.13.020

2009-01-01

Abstract:As a fresh growth on technology and economy,new solutions of telematics,navigation,internet and entertainment while driving based on In-Vehicle Information System(IVIS) was applied widely in automobile industry recently.The process of automobile-informationization has been accelerated gradually.However,based on Multi-Resource Theory,the application of IVIS during driving in forms of display check and text input distracted drivers visually in certain degrees,which caused threats to driving safety by competing with major driving tasks on visual,cognitive and other resources.Previous research found that the glance frequency and duration from using IVIS related to crashes and traffic dangers directly,meanwhile,decreased driver's ability on detecting key road incidents and controlling vehicles.Thus the safety design of IVIS,which focused on human-machine interactive method and driver's behavioral character,was very important.General methodologies of such research include field test,simulation test and simple laboratory test.
Research on the Effects of in-Vehicle Human-Machine Interface on Drivers' Pre and Post Takeover Request Eye-tracking Characteristics

Chao Zeng,Zhenyuan Wang,Qingkun Li,Wenjun Wang,Bo Cheng,Weimin Liu

DOI: https://doi.org/10.1109/CONIT55038.2022.9848040

2022-06-24

Abstract:In-vehicle Human-Machine Interface (HMI) plays a significant role for conditionally automated vehicles in realizing effective communications from driving automation systems to drivers during either automated driving period or control transitions. The present study aimed to investigate the effects of in-vehicle HMI on drivers' eye-tracking characteristics pre and post takeover request (TOR). A driving simulator-based experiment was conducted comparing the differences of drivers' visual behaviors with or without HMI under two TB (time budget) conditions (TB = 4 s; TB = 10 s). The visual HMI adopted in the experiments consisted of vehicle status display and a bird-view depiction of the traffic situation. Experiment results showed fixations prior to the TOR were more frequently shifted from real traffic situation to HMI which was effective in indirectly maintaining drivers' mode and situation awareness. Pre TOR entropy measures indicated a more dispersed but still ordered scanning pattern in spatial sampling. Saccadic behaviors were shown to be encouraged for a less cognitively demanded but a more visually loaded acquisition of surrounding information with the assistance of HMI. Post TOR fixation measure showed a prolonged Eyes-on-Traffic-Time (EoTT) when HMI was provided. And as a physiological indicator for mental workload, blink rate and blink latency did not show an additional increase after the issue of TOR under “with HMI” condition. We conclude that the introduction of in-vehicle visual HMI can be a valid option to support drivers in both automated driving and takeover time.

Engineering,Computer Science
Investigating the Effects of External Communication and Automation Behavior on Manual Drivers at Intersections

Mark Colley,Tim Fabian,Enrico Rukzio

DOI: https://doi.org/10.1145/3546711

2022-09-20

Abstract:Automated vehicles are expected to substitute or even improve driver-driver communication, for example, via LED strips or displays. Numerous situations exist where ambiguities have to be resolved via gestures or implicit communication (i.e., movement). An already demanding situation is the unsignalized four-way intersection. Additionally, Vehicle-To-Everything technology enables automated vehicles to perform maneuvers impossible before such as blocking an intersection to safely let an emergency vehicle pass. Therefore, we report the results of a within-subject Virtual Reality study (N=17) evaluating these two scenarios. Results show that external communication increased perceived safety and reduced mental workload, and also that the novel behavior confused participants. Our work helps better to integrate external communication in settings with manual drivers.
Human Factors in Automotive HMI Design

Sihan Chen

DOI: https://doi.org/10.54097/ajst.v2i3.1583

2022-09-12

Academic Journal of Science and Technology

Abstract:Driving is an information processing activity. In the process of driving, the driver constantly obtains and processes information from various sensory channels to make decisions and take appropriate actions to control vehicle movement. This paper will discuss four parts: sensory, cognition, decision making and automation.
Transitioning to multi-dimensional estimation of visual distraction and its safety effects under automated driving: A spatiotemporal and directional estimation approach

Song Wang,Zhixia Li,Chao Zeng,Jia Hu

DOI: https://doi.org/10.1016/j.trc.2023.104212

2023-06-29

Abstract:Traditional methodologies for measuring visual distraction have been limiting in their approaches, treating distraction as a one-dimensional variable. This has been accomplished either by categorizing distraction as a binary variable or using surrogate measurements, such as reaction time in response to non-driving related tasks, which follow the procedures of measuring distraction from psychology. Furthermore, as human-vehicle interaction (HVI) under automated driving has the potential to provide safety information and bring visual distraction simultaneously, there lacks an investigation on the quantitative relationship between distraction and safety due to the restrained methodologies in measuring visual distraction. As HVI-induced driver distraction plays a critical role in determining safe driving under automated driving, a methodology is highly needed to comprehensively measure the visual distraction under automated driving so that its impact on safety can be further investigated. Therefore, sticking to the definition of visual distraction, this research aims to (1) improve the existing methodology in measuring HVI-induced driver distraction under automated driving by focusing on visual distraction and mathematically describing it from spatiotemporal and directional dimensions; (2) theoretically investigate how the quantified visual distraction influences driving safety and (3) quantify the relationship between distraction and safety with introducing the "distraction-safety" ratio. Drivers' fixation behaviors are used in quantifying visual distraction, which is measured by spatiotemporal and directional relationships between drivers' visual attention and the attention that indicates "zero distraction". Three newly added performance measures in quantifying HVI-induced visual distraction are real-time magnitudes, real-time directions, and intensities (cumulation of magnitudes over time). To validate the proposed methods, a verification study was conducted by recruiting drivers to test automated driving under Level 3 automation. Drivers are required to wear an eye-tracker and go through two scenarios interacting with jaywalkers where takeover actions are needed with two takeover warnings ("visual-only" and "visual & audible"). Per past studies, takeover time was measured in representing distraction level. As a result, this study confirms the validity of the proposed methods by revealing the significant and positive correlations between the measured distraction intensity and the takeover time. Discussions of the quantified visual distraction from the spatiotemporal and directional perspective further enhance the understanding of HVI-induced driver distraction under automated driving through multiple dimensions. Furthermore, this research reveals how distracted driving affects safety under automated driving through the takeover performance. Thresholds under visual distraction magnitudes and degrees that lead to traffic conflicts were identified. More importantly, a "distraction-safety" ratio that quantifies the relationship between visual distraction and safety benefits is proposed. The results suggest that the "visual & audible" is more effective in significantly enhancing safety while aggregating a significantly smaller amount of visual distraction. The contribution of this research is to re-define the methodological approach of measuring visual distraction by (1) measuring distraction multi-dimensionally and (2) establishing a "distraction-safety" system in quantitatively assessing the balance of safety benefits and the HVI-induced visual distraction magnitude under automated driving environment.

transportation science & technology
In-Vehicle Human Machine Interface: Investigating the Effects of Tactile Displays on Information Presentation in Automated Vehicles

Kimberly D. Martinez,Gaojian Huang

DOI: https://doi.org/10.1109/access.2022.3205022

IF: 3.9

2022-09-17

IEEE Access

Abstract:Background: Semi-autonomous vehicles still require human drivers to take over when the automated systems can no longer perform the driving task. Objective: The goal of this study was to design and test the effects of six meaningful tactile signal types, representing six driving scenarios (i.e., navigation, speed, surrounding vehicles, over the speed limit, headway reductions, and pedestrian status) respectively, and two pattern durations (lower and higher urgencies), on drivers' perception and performance during automated driving. Methods: Sixteen volunteers participated in an experiment utilizing a medium-fidelity driving simulator presenting vibrotactile signals via 20 tactors embedded in the seat back, pan, and belt. Participants completed four separate driving sessions with 30 tactile signals presented randomly throughout each drive. Reaction times (RT), interpretation accuracy, and subjective ratings were measured. Results: Results illustrated shorter RTs and higher intuitive ratings for higher urgency patterns than lower urgency patterns. Pedestrian status and headway reduction signals were associated with shorter RTs and increased confidence ratings, compared to other tactile signal types. Lastly, among six tactile signals, surrounding vehicle and navigation signal types had the highest interpretation accuracy. Conclusion: These results will be used as preliminary data for future studies that aim to investigate the effects of meaningful tactile displays on automated vehicle takeover performance in complex situations (e.g., urban areas) where actual takeovers are required. The findings of this study will inform the design of next-generation in-vehicle human-machine interfaces.

computer science, information systems,telecommunications,engineering, electrical & electronic
The effects of using taxi-hailing application on driving performance

Xiexing Feng,Libo Cao,Yunxian Zhang,Hongbo Gao,Lifan Tan

DOI: https://doi.org/10.1177/1729881419830216

IF: 1.714

2019-01-01

International Journal of Advanced Robotic Systems

Abstract:Driver distraction has become a major threat to the road safety, and the globally booming taxi-hailing application introduces new source of distraction to drivers. Although various in-vehicle information systems have been studied extensively, no documentation exists objectively measuring the extent to which interacting with taxi-hailing application during driving impacts drivers’ behavior. To fill this gap, a simulator-based study was conducted to synthetically compare the effects that different output modalities (visual, audio, and combined visual–audio) and input modalities (baseline, manual, and speech) imposed on the driving performance. The results show that the visual output introduced more negative effects on driving performance compared to audio output. In the combined output, visual component dominated the effects imposed on the longitudinal control and hazard detection; audio component only exacerbated the negative effects of visual component on the lateral control. Speech input modality was overall less detrimental to driving performance than manual input modality, especially reflected in the drivers’ quicker reaction to hazard events. The visual–manual interaction modality most severely impaired the hazard detecting ability, while also led to strong compensative behaviors. The audio–speech and visual–speech modality associated with more smooth lateral control and faster response to hazard events, respectively, compared to other modality. These results could be applied to improve the design of not only the taxi-hailing application but also other input–output balanced in-vehicle information systems.

robotics
External Human-Machine Interfaces on Automated Vehicles: Effects on Pedestrian Crossing Decisions

Koen de Clercq,Andre Dietrich,Juan Pablo Núñez Velasco,Joost de Winter,Riender Happee

DOI: https://doi.org/10.1177/0018720819836343

Abstract:Objective: In this article, we investigated the effects of external human-machine interfaces (eHMIs) on pedestrians' crossing intentions. Background: Literature suggests that the safety (i.e., not crossing when unsafe) and efficiency (i.e., crossing when safe) of pedestrians' interactions with automated vehicles could increase if automated vehicles display their intention via an eHMI. Methods: Twenty-eight participants experienced an urban road environment from a pedestrian's perspective using a head-mounted display. The behavior of approaching vehicles (yielding, nonyielding), vehicle size (small, medium, large), eHMI type (1. baseline without eHMI, 2. front brake lights, 3. Knightrider animation, 4. smiley, 5. text [WALK]), and eHMI timing (early, intermediate, late) were varied. For yielding vehicles, the eHMI changed from a nonyielding to a yielding state, and for nonyielding vehicles, the eHMI remained in its nonyielding state. Participants continuously indicated whether they felt safe to cross using a handheld button, and "feel-safe" percentages were calculated. Results: For yielding vehicles, the feel-safe percentages were higher for the front brake lights, Knightrider, smiley, and text, as compared with baseline. For nonyielding vehicles, the feel-safe percentages were equivalent regardless of the presence or type of eHMI, but larger vehicles yielded lower feel-safe percentages. The Text eHMI appeared to require no learning, contrary to the three other eHMIs. Conclusion: An eHMI increases the efficiency of pedestrian-AV interactions, and a textual display is regarded as the least ambiguous. Application: This research supports the development of automated vehicles that communicate with other road users.

Effect of human–machine interface infotainment systems and automated vehicles on driver distraction

Discovering the Power of External Human-Machine Interface: an EEG Study on the Driving Anger Regulation

The effect of in‐vehicle agent embodiment on drivers' perceived usability and cognitive workload: Evidence from subjective reporting, ECG, and fNIRS

Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

Effects of Various In-Vehicle Human-Machine Interfaces on Drivers' Takeover Performance and Gaze Pattern in Conditionally Automated Vehicles

Assessing driver distraction from in-vehicle information system: an on-road study exploring the effects of input modalities and secondary task types

In-Vehicle Interface Adaptation to Environment-Induced Cognitive Workload

Evaluation of Gesture-Based In-Vehicle Interaction: User Experience and the Potential to Reduce Driver Distraction

The effect of human-machine interface modality, specificity, and timing on driver performance and behavior while using vehicle automation

Evaluation of Three In-Vehicle Interactions from Drivers' Driving Performance and Eye Movement Behavior.

Advancements in the Intelligent Detection of Driver Fatigue and Distraction: A Comprehensive Review

Impact of HMI on driver’s distraction on a freeway under heavy foggy condition based on visual characteristics

Quantifying the Remote Driver's Interaction with 5G-Enabled Level 4 Automated Vehicles: A Real-World Study

In-Vehicle Information System and Driving Safety

Research on the Effects of in-Vehicle Human-Machine Interface on Drivers' Pre and Post Takeover Request Eye-tracking Characteristics

Investigating the Effects of External Communication and Automation Behavior on Manual Drivers at Intersections

Human Factors in Automotive HMI Design

Transitioning to multi-dimensional estimation of visual distraction and its safety effects under automated driving: A spatiotemporal and directional estimation approach

In-Vehicle Human Machine Interface: Investigating the Effects of Tactile Displays on Information Presentation in Automated Vehicles

The effects of using taxi-hailing application on driving performance

External Human-Machine Interfaces on Automated Vehicles: Effects on Pedestrian Crossing Decisions