Abstract:In the field of Natural Human-Machine Interaction (NHMI), wearable gesture interaction technologies have received considerable attention, particularly Continuous Gesture Recognition (CG). However, CG faces several challenges, including the impact of motion characteristics on gesture recognition and performance that is not sufficiently robust. Traditional algorithms are highly dependent on samples, thus meeting the requirements of low sample volume and high accuracy simultaneously is challenging. To address these challenges, we propose a real-time continuous gesture recognition system based on Particle Swarm Optimization (PSO) and Probabilistic Neural Network (PNN). This system employs Principal Component Analysis (PCA) for signal dimensionality reduction to alleviate computational burden and uses K-means clustering and Pearson Correlation Coefficient (PCC) to extract optimal features for gesture classification. In offline gesture recognition experiments involving six continuous gestures, the algorithm achieved an accuracy rate of 97% with a training set of 300 samples and a runtime of just 31.25ms. Compared to other five algorithms, the proposed algorithm improved accuracy by at least 9% and reduced the runtime by 40.475ms. Moreover, gesture recognition experiments were conducted using different datasets, with the PSO-PNN algorithm achieving an average recognition rate of 90.17%, at least 9.84% higher than other algorithms. Finally, in experiments on online continuous gesture control for robots in complex environments, the PSO-PNN demonstrated real-time performance of 28.56ms and a task completion rate of 90.67%, validating the feasibility of PSO-PNN. This research provides a substantial theoretical and technical foundation for the ongoing enhancement and application of continuous gesture recognition technology.

Real-Time and Continuous Hand Gesture Spotting: an Approach Based on Artificial Neural Networks

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

A gesture recognition system using Localist Attractor Networks for human-robot interaction

Efficient Hand Gesture Recognition for Human-Robot Interaction

Real-Time Gesture Recognition with Virtual Glove Markers

Online Recognition of Incomplete Gesture Data to Interface Collaborative Robots

Continuous Hand Gestures Detection and Recognition in Emergency Human-Robot Interaction Based on the Inertial Measurement Unit

A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

A Deep Learning Framework for Recognizing both Static and Dynamic Gestures

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

An Integrative Framework of Human Hand Gesture Segmentation for Human–Robot Interaction

Real-Time Hand Gesture Spotting and Recognition Using RGB-D Camera and 3D Convolutional Neural Network

Realtime Recognition of Dynamic Hand Gestures in Practical Applications

Deep Learning Based Real-Time Recognition of Dynamic Finger Gestures Using a Data Glove

Real-time Vision-based Gesture Recognition for Human Robot Interaction

Real-Time Continuous Gesture Recognition System Based on PSO-PNN

Real-time dynamic gesture recognition system based on depth perception for robot navigation

High-level programming and control for industrial robotics: using a hand-held accelerometer-based input device for gesture and posture recognition

A Real-Time Approach to the Spotting, Representation, and Recognition of Hand Gestures for Human–Computer Interaction

Accelerometer-based control of an industrial robotic arm

Surface Electromyography Signal Recognition Based on Deep Learning for Human-Robot Interaction and Collaboration