Abstract:Abstract There was a problem of great distraction in traditional touch interactive operation of in-vehicle information interface, but the application of gesture recognition technology on in-vehicle system improved this problem. However, users had less experience in this new interactive mode, and the cognitive deviation of the agreement between gestures and commands could directly affect the safety of drivers. The main purpose of this paper was to obtain the user's preference mid-air gestures for the in-vehicle information interface by using the user-elicitation method. In addition, the optimized gesture recognition network structure was applied to the prototype system of in-vehicle information interaction with user-defined mid-air gestures developed by us, and the effectiveness of the system was evaluated by collecting eye movement indicators of users through the simulation of driving eye movement experiments. In the process of user elicitation, the principle of command prompt and agreement rate was introduced. According to the agreement rate elicited by users (AR = .397), we got the gesture consensus set design direction of in-vehicle information control. The experimental results of the eye movement index showed that the method of user-defined mid-air gestures can effectively improve driving safety on in-vehicle media control, and reduced the distraction of users when driving compared with the traditional touch-based method. Article highlights The user's preferred in-vehicle media control task gestures were obtained through the user elicitation method. Constructed an in-vehicle secondary task control prototype system based on gesture recognition. The eye movement experiment proved that the prototype system can reduce the user's distraction when operating the in-vehicle's secondary tasks.

Implementation And Evaluation Of Touch And Gesture Interaction Modalities For In-Vehicle Infotainment Systems

Join driving: A smart phone-based driving behavior evaluation system

Mid-air gestures for in-vehicle media player: elicitation, segmentation, recognition, and eye-tracking testing

Evaluation of Gesture-Based In-Vehicle Interaction: User Experience and the Potential to Reduce Driver Distraction

A Human Factors Evaluation of the Spatial Gesture Interface for In-Vehicle Information Systems.

The intuitive grasp interface: design and evaluation of micro-gestures on the steering wheel for driving scenario

Do users desire gestures for in-vehicle interaction? Towards the subjective assessment of gestures in a high-fidelity driving simulator

Enhancing Interactions for In-Car Voice User Interface with Gestural Input on the Steering Wheel

Evaluation of Three In-Vehicle Interactions from Drivers' Driving Performance and Eye Movement Behavior.

Vehicle Human-Machine Interaction Interface Evaluation Method Based on Eye Movement and Finger Tracking Technology

In-Vehicle Human Machine Interface: Investigating the Effects of Tactile Displays on Information Presentation in Automated Vehicles

Testing the Cognitive Load of Gesture Interaction on Drivers When Performing Tertiary Tasks

"Tell me about that church": Exploring the Design and User Experience of In-Vehicle Multi-modal Intuitive Interface in the Context of Driving Scenario

Augmented Affective-Cognition for Usability Study of In-Vehicle System User Interface

Social Car: the Research of Interaction Design on the Driver's Communication System.

Design and evaluation of a steering wheel-mount speech interface for drivers' mobile use in car

Vision-Based Hand Gesture Recognition for Human-Vehicle Interaction

The validity of driving simulation for assessing differences between in-vehicle informational interfaces: A comparison with field testing.

A Wearable Virtual Touch System for Cars

Evaluation of Multimodal External Human–Machine Interface for Driverless Vehicles in Virtual Reality

Multimodal user interaction with in-car equipment in real conditions based on touch and speech modes in the Persian language