Abstract:Abstract There was a problem of great distraction in traditional touch interactive operation of in-vehicle information interface, but the application of gesture recognition technology on in-vehicle system improved this problem. However, users had less experience in this new interactive mode, and the cognitive deviation of the agreement between gestures and commands could directly affect the safety of drivers. The main purpose of this paper was to obtain the user's preference mid-air gestures for the in-vehicle information interface by using the user-elicitation method. In addition, the optimized gesture recognition network structure was applied to the prototype system of in-vehicle information interaction with user-defined mid-air gestures developed by us, and the effectiveness of the system was evaluated by collecting eye movement indicators of users through the simulation of driving eye movement experiments. In the process of user elicitation, the principle of command prompt and agreement rate was introduced. According to the agreement rate elicited by users (AR = .397), we got the gesture consensus set design direction of in-vehicle information control. The experimental results of the eye movement index showed that the method of user-defined mid-air gestures can effectively improve driving safety on in-vehicle media control, and reduced the distraction of users when driving compared with the traditional touch-based method. Article highlights The user's preferred in-vehicle media control task gestures were obtained through the user elicitation method. Constructed an in-vehicle secondary task control prototype system based on gesture recognition. The eye movement experiment proved that the prototype system can reduce the user's distraction when operating the in-vehicle's secondary tasks.

In-Vehicle Wireless Gesture Recognition System Based Attention-Enhanced Lightweight Model

Dynamic Driving Intention Recognition of Vehicles with Different Driving Styles of Surrounding Vehicles

AL-MobileNet: a Novel Model for 2D Gesture Recognition in Intelligent Cockpit Based on Multi-Modal Data

WiFi-Based Gesture Recognition for Vehicular Infotainment System—An Integrated Approach

Simple But Effective: Upper-Body Geometric Features for Traffic Command Gesture Recognition

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Real-Time Multiple Gesture Recognition: Application of a Lightweight Individualized 1D CNN Model to an Edge Computing System

It's all about you: Personalized in-Vehicle Gesture Recognition with a Time-of-Flight Camera

Gesture Recognition with a 3-D Accelerometer

Dynamic Hand Gesture Recognition in In-Vehicle Environment Based on FMCW Radar and Transformer

GLADAS: Gesture Learning for Advanced Driver Assistance Systems

Mid-air gestures for in-vehicle media player: elicitation, segmentation, recognition, and eye-tracking testing

"It Must Be Gesturing Towards Me": Gesture-Based Interaction between Autonomous Vehicles and Pedestrians

Visual Recognition of traffic police gestures with convolutional pose machine and handcrafted features

A Novel Gesture Recognition System Based on CSI Extracted from a Smartphone with Nexmon Firmware

ML-WiGR: a meta-learning-based approach for cross-domain device-free gesture recognition

Driver Emotion Recognition Involving Multimodal Signals: Electrophysiological Response, Nasal-Tip Temperature, and Vehicle Behavior

Hand Gesture Recognition System for In-car Device Control Based on Infrared Array Sensor

Research on a Cognitive Distraction Recognition Model for Intelligent Driving Systems Based on Real Vehicle Experiments

The diffusion coefficient of a swollen microgel particle.

A Human Factors Evaluation of the Spatial Gesture Interface for In-Vehicle Information Systems.