"Tell me about that church": Exploring the Design and User Experience of In-Vehicle Multi-modal Intuitive Interface in the Context of Driving Scenario

Yueteng Yu,Yan Zhang,Gary Burnett

2023-11-08

Abstract:Intuitive interaction has long been seen as a highly user-friendly method. There are attempts to implement intuitive interfaces in vehicles in both research and industrial, such as voice commands. However, there is a lack of exploration in the in-vehicle multi-modal intuitive interaction, especially under a dynamic driving scenario. In this research, we conducted a design workshop (N=6) to understand user's needs and designers' considerations on the in-vehicle multi-modal intuitive interface, based on which we implemented our design on both a simulator and a real autonomous vehicle using Wizard-of-Oz. We conducted a user experiment (N=12) on the simulator to explore determinants of users' acceptance, experience, and behavior. We figured that acceptance was significantly influenced by six determinants. Drivers' behavior has an obvious pattern of change. Drivers have been proven to have less workload but distractions were also reported. Our findings offered empirical evidence which could give insights into future vehicle design.

Human-Computer Interaction

What problem does this paper attempt to address?

The paper attempts to address the lack of research on in-car multimodal intuitive interfaces in dynamic driving scenarios. Specifically, the paper focuses on the following aspects:

1. **User Needs and Designer Considerations**: Understanding user needs for in-car multimodal intuitive interfaces and the considerations of designers during the design process through Design Workshops.

2. **System Implementation**: Based on the results of the Design Workshops, implementing the designed multimodal intuitive interfaces in both driving simulators and real autonomous vehicles.

3. **User Acceptance, Experience, and Behavior Evaluation**: Evaluating user acceptance, experience, and behavior performance of the designed multimodal intuitive interaction system through user experiments, exploring key factors affecting user acceptance, and analyzing changes in driver behavior patterns.

The goal of the paper is to fill the current research gap regarding in-car multimodal intuitive interaction design and user experience in dynamic driving scenarios, providing empirical evidence and design recommendations for future vehicle design.