Abstract:Robots have become increasingly prevalent in various aspects of daily life. In an increasing number of scenarios, particularly in social contexts, such as those involving delivery robots and self-driving buses, human-robot interaction (HRI) is essential for conveying decision commands to the robot's control algorithm. The growing convergence of human activity spaces and robot workspaces presents increasingly emergent and challenging interaction scenarios. This transformation necessitates convenient measurement sensor and gesture recognition algorithms with shorter recognition delays and more reliable recognition results. In pursuit of this objective, we propose a novel pipeline for continuous and rapid gesture recognition employing a portable inertial measurement unit (IMU) device. First, we design a lightweight neural network (NN) to distinguish the gesture from daily hand movement (gesture spotting). Then, one lookback window evaluation is inserted between gesture spotting and recognition, aiming to reduce the false positive rate of gesture spotting. Finally, a novel transformer-based model is used to recognize expected hand gestures (gesture recognition), which can consider both cross-time and cross-sensor dependencies. In this study, the IMU data of six gestures are collected from 20 participants for training and validation. The experimental results show that the proposed gesture spotting model detects all gesture movements in the test data with a 0.3% false positive rate. The gesture recognition model achieves better accuracy than multiple state-of-the-art models. Overall, this study proposes an efficient and reliable pipeline for single IMU-based continuous gesture recognition for practical applications.

Haar-Feature Based Gesture Detection of Hand-Raising for Mobile Robot in HRI Environments

Dynamic hand gesture recognition using hidden Markov models

Detection Of Hands-Raising Gestures Using Shape And Edge Features

A Gait Recognition System for Interaction with a Homecare Mobile Robot

Detection of hand-raising gestures based on body silhouette analysis

A real-time hand gesture recognition method

Hand Posture Recognition and Tracking Based on Bag-of-Words for Human Robot Interaction

Hand-Raising Gesture Detection in Real Classroom

A gesture recognition system using Localist Attractor Networks for human-robot interaction

Who Are Raising Their Hands? Hand-Raiser Seeking Based on Object Detection and Pose Estimation.

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

Finger Angle-Based Hand Gesture Recognition for Smart Infrastructure Using Wearable Wrist-Worn Camera

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

Fast and Accurate Hand-Raising Gesture Detection in Classroom.

Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction

Continuous Hand Gestures Detection and Recognition in Emergency Human-Robot Interaction Based on the Inertial Measurement Unit

Real-time Vision-based Gesture Recognition for Human Robot Interaction

Gesture Based Human-Robot Interaction Using a Frame Based Software Platform

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Gesture Recognition for Human-Robot Interaction Through a Knowledge Based Software Platform