Abstract:Abstract There was a problem of great distraction in traditional touch interactive operation of in-vehicle information interface, but the application of gesture recognition technology on in-vehicle system improved this problem. However, users had less experience in this new interactive mode, and the cognitive deviation of the agreement between gestures and commands could directly affect the safety of drivers. The main purpose of this paper was to obtain the user's preference mid-air gestures for the in-vehicle information interface by using the user-elicitation method. In addition, the optimized gesture recognition network structure was applied to the prototype system of in-vehicle information interaction with user-defined mid-air gestures developed by us, and the effectiveness of the system was evaluated by collecting eye movement indicators of users through the simulation of driving eye movement experiments. In the process of user elicitation, the principle of command prompt and agreement rate was introduced. According to the agreement rate elicited by users (AR = .397), we got the gesture consensus set design direction of in-vehicle information control. The experimental results of the eye movement index showed that the method of user-defined mid-air gestures can effectively improve driving safety on in-vehicle media control, and reduced the distraction of users when driving compared with the traditional touch-based method. Article highlights The user's preferred in-vehicle media control task gestures were obtained through the user elicitation method. Constructed an in-vehicle secondary task control prototype system based on gesture recognition. The eye movement experiment proved that the prototype system can reduce the user's distraction when operating the in-vehicle's secondary tasks.

A Human Factors Evaluation of the Spatial Gesture Interface for In-Vehicle Information Systems.

Mid-air gestures for in-vehicle media player: elicitation, segmentation, recognition, and eye-tracking testing

The intuitive grasp interface: design and evaluation of micro-gestures on the steering wheel for driving scenario

Evaluation of Gesture-Based In-Vehicle Interaction: User Experience and the Potential to Reduce Driver Distraction

A Design Space for Human Sensor and Actuator Focused In-Vehicle Interaction Based on a Systematic Literature Review

Do users desire gestures for in-vehicle interaction? Towards the subjective assessment of gestures in a high-fidelity driving simulator

Vehicle Human-Machine Interaction Interface Evaluation Method Based on Eye Movement and Finger Tracking Technology

Design of Human-Machine Interaction Interface for Autonomous Vehicles Based on Multidimensional Perceptual Context

Enhancing Interactions for In-Car Voice User Interface with Gestural Input on the Steering Wheel

Using a Configurational Approach to Examine the Impacts of Vehicle Appearance Perception on Pedestrian Acceptance of the External Human-Machine Interfaces on Autonomous Vehicles

Human Factor Studies on Gestural Interaction: Past, Present, and Future

Augmented Affective-Cognition for Usability Study of In-Vehicle System User Interface

"Tell me about that church": Exploring the Design and User Experience of In-Vehicle Multi-modal Intuitive Interface in the Context of Driving Scenario

"It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and Pedestrians

Designing Gaze-Based Interactions for Teleoperation: Eye Stick and Eye Click

3D Intuitive Gesture Interaction via Motion Sensing

Evaluation of Multimodal External Human–Machine Interface for Driverless Vehicles in Virtual Reality

UI Design of eHMI of Autonomous Vehicles

Evaluating User Experience for Intelligent Connected Vehicles: A Qualitative Study

Shaping driver-vehicle interaction in autonomous vehicles: How the new in-vehicle systems match the human needs

Designing Future In-Vehicle Assistants: Insights from User Imaginations and Experiences.