Abstract:Abstract There was a problem of great distraction in traditional touch interactive operation of in-vehicle information interface, but the application of gesture recognition technology on in-vehicle system improved this problem. However, users had less experience in this new interactive mode, and the cognitive deviation of the agreement between gestures and commands could directly affect the safety of drivers. The main purpose of this paper was to obtain the user's preference mid-air gestures for the in-vehicle information interface by using the user-elicitation method. In addition, the optimized gesture recognition network structure was applied to the prototype system of in-vehicle information interaction with user-defined mid-air gestures developed by us, and the effectiveness of the system was evaluated by collecting eye movement indicators of users through the simulation of driving eye movement experiments. In the process of user elicitation, the principle of command prompt and agreement rate was introduced. According to the agreement rate elicited by users (AR = .397), we got the gesture consensus set design direction of in-vehicle information control. The experimental results of the eye movement index showed that the method of user-defined mid-air gestures can effectively improve driving safety on in-vehicle media control, and reduced the distraction of users when driving compared with the traditional touch-based method. Article highlights The user's preferred in-vehicle media control task gestures were obtained through the user elicitation method. Constructed an in-vehicle secondary task control prototype system based on gesture recognition. The eye movement experiment proved that the prototype system can reduce the user's distraction when operating the in-vehicle's secondary tasks.

FITS: Ensuring Safe and Effective Touchscreen Use in Moving Vehicles

The Impacts of Touchscreen and Physical Control Interface Characteristics on Driver Distraction and Attention Management

Implementation And Evaluation Of Touch And Gesture Interaction Modalities For In-Vehicle Infotainment Systems

The influence of tactile feedback in In-vehicle central control interfaces on driver emotions: A comparative study of touchscreens and physical buttons

In-Vehicle Human Machine Interface: Investigating the Effects of Tactile Displays on Information Presentation in Automated Vehicles

Vibrotactile Displays: A Survey With a View on Highly Automated Driving

Evaluation of Gesture-Based In-Vehicle Interaction: User Experience and the Potential to Reduce Driver Distraction

A Wearable Virtual Touch System for Cars

Where's My Button? Evaluating the User Experience of Surface Haptics in Featureless Automotive User Interfaces

Do users desire gestures for in-vehicle interaction? Towards the subjective assessment of gestures in a high-fidelity driving simulator

A Vehicle Simulation Study Examining the Effects of System Interface Design Elements on Performance in Different Vibration Environments below 3 Hz.

Mid-air gestures for in-vehicle media player: elicitation, segmentation, recognition, and eye-tracking testing

On the forces of driver distraction: Explainable predictions for the visual demand of in-vehicle touchscreen interactions

To Inform or to Instruct? An Evaluation of Meaningful Vibrotactile Patterns to Support Automated Vehicle Takeover Performance

Multitasking While Driving: How Drivers Self-Regulate Their Interaction with In-Vehicle Touchscreens in Automated Driving

How does age impact in-vehicle touchscreen performance?

Driving Distraction Evaluation Model of In-Vehicle Infotainment Systems Based on Driving Performance and Visual Characteristics

HapWheel: Bringing In-Car Controls to Driver’s Fingertips by Embedding Ubiquitous Haptic Displays into a Steering Wheel

The Effects of Tactile Display on Automated Vehicle Takeover: A Literature Review

HapWheel: In-Car Infotainment System Feedback Using Haptic and Hovering Techniques