Abstract:Robots have become increasingly prevalent in various aspects of daily life. In an increasing number of scenarios, particularly in social contexts, such as those involving delivery robots and self-driving buses, human-robot interaction (HRI) is essential for conveying decision commands to the robot's control algorithm. The growing convergence of human activity spaces and robot workspaces presents increasingly emergent and challenging interaction scenarios. This transformation necessitates convenient measurement sensor and gesture recognition algorithms with shorter recognition delays and more reliable recognition results. In pursuit of this objective, we propose a novel pipeline for continuous and rapid gesture recognition employing a portable inertial measurement unit (IMU) device. First, we design a lightweight neural network (NN) to distinguish the gesture from daily hand movement (gesture spotting). Then, one lookback window evaluation is inserted between gesture spotting and recognition, aiming to reduce the false positive rate of gesture spotting. Finally, a novel transformer-based model is used to recognize expected hand gestures (gesture recognition), which can consider both cross-time and cross-sensor dependencies. In this study, the IMU data of six gestures are collected from 20 participants for training and validation. The experimental results show that the proposed gesture spotting model detects all gesture movements in the test data with a 0.3% false positive rate. The gesture recognition model achieves better accuracy than multiple state-of-the-art models. Overall, this study proposes an efficient and reliable pipeline for single IMU-based continuous gesture recognition for practical applications.

Visual gesture recognition for human robot interaction using dynamic movement primitives

Dynamic hand gesture recognition using hidden Markov models

A gesture recognition system using Localist Attractor Networks for human-robot interaction

Real-time dynamic gesture recognition system based on depth perception for robot navigation

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Natural Gesture Modeling and Recognition Approach Based on Joint Movements and Arm Orientations

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

Dynamic Hand Gesture-Featured Human Motor Adaptation in Tool Delivery using Voice Recognition

Visually Gesture Recognition for an Interactive Robot Grasping Application

Gesture Recognition with a 3-D Accelerometer

Skeleton Guided Conflict-Free Hand Gesture Recognition for Robot Control.

A dynamic gesture recognition method based on computer vision

Comparative Analysis on Few Typical Algorithms of Gesture Recognition for Human-robot Interaction.

A Multi-sensor Gesture Interaction System for Human-robot Cooperation

Dynamic Gesture Recognition by Directional Pulse Coupled Neural Networks for Human-Robot Interaction in Real Time.

Continuous Hand Gestures Detection and Recognition in Emergency Human-Robot Interaction Based on the Inertial Measurement Unit

Improving dynamic gesture recognition in untrimmed videos by an online lightweight framework and a new gesture dataset ZJUGesture

A Dynamic Hand Gesture Recognition Model Based on the Improved Dynamic Time Warping Algorithm.

A Vision-Based Gesture Recognition System For Human-Robot Interaction