Abstract:Regression-based sEMG prosthetic hands are widely used for their ability to provide continuous kinetic and kinematic parameters. However, establishing these models requires complex sensors systems to collect corresponding kinetic and kinematic data in synchronization with sEMG, which is cumbersome and user-unfriendly. This paper proposes a kinetic and kinematic sensors-free approach for controlling sEMG prosthetic hands, enabling continuous decoding and execution of three hand movements: individual finger flexion/extension, multiple finger flexion/extension, and fist opening/closing. This approach utilizes only two data points (-1 and 1), representing maximal finger flexion force label and extension force label respectively, and their corresponding sEMG data to establish a near-linear model based on sEMG data and labels. The model's output labels values are used to control the direction and magnitude of fingers forces, enabling the estimation of continuous gestures. To validate this approach, we conducted offline and online experiments using four models: Dendritic Net (DD), Linear Net (LN), Multi-Layer Perceptron (MLP), and Convolutional Neural Network (CNN). The offline analysis assessed each model's ability to classify finger force direction and interpolate intermediate force values, while online experiments evaluated real-time control performance in controlling gestures and accurately adjusting forces. Our results demonstrate that the DD and LN models provide excellent real-time control of finger forces and gestures, highlighting the practical potential of this sensors-free approach for prosthetic applications. This study significantly reduces the complexity of collecting kinetic and kinematic parameters in sEMG-based regression prosthetics, thus enhancing the usability and convenience of prosthetic hands.

A Novel Hand-Gesture Recognition Method Based On Finger State Projection For Control Of Robotic Hands

Real-time Dynamic Gesture Recognition and Hand Servo Tracking Using PTZ Camera

Gesture Recognition Based on Localist Attractor Networks with Application to Robot Control [Application Notes]

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Interaction and control with the auxiliary of hand gesture

Finger Angle-Based Hand Gesture Recognition for Smart Infrastructure Using Wearable Wrist-Worn Camera

A gesture recognition system using Localist Attractor Networks for human-robot interaction

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

A Novel Data Glove Using Inertial and Magnetic Sensors for Motion Capture and Robotic Arm-Hand Teleoperation

Seamless Robot Teleoperation: Intuitive Control Through Hand Gestures and Neural Network Decoding

Efficient Hand Gesture Recognition for Human-Robot Interaction

Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors

Multifingered Robot Hand Compliant Manipulation Based on Vision-Based Demonstration and Adaptive Force Control

Adaptive sensor fusion labeling framework for hand pose recognition in robot teleoperation

Real time robotic arm control using hand gestures

Finger Gesture Recognition Based on Wireless Coupling Resonance

Development of a Visual-Tactile Fingertip Sensor and an Object Manipulation Method using a Multi-Fingered Robotic Hand

Control Strategy for Underactuated Multi-Fingered Robot Hand Movement Using Electromyography Signal with Wearable Myo Armband

Kinetic and Kinematic Sensors-free Approach for Estimation of Continuous Force and Gesture in sEMG Prosthetic Hands

Hands-On Robotics: Enabling Communication Through Direct Gesture Control