Abstract:High-density electromyography (HD-EMG) can provide a natural interface to enhance human-computer interaction (HCI). This study aims to demonstrate the capability of a novel HD-EMG forearm sleeve equipped with up to 150 electrodes to capture high-resolution muscle activity, decode complex hand gestures, and estimate continuous hand position via joint angle predictions. Ten able-bodied participants performed 37 hand movements and grasps while EMG was recorded using the HD-EMG sleeve. Simultaneously, an 18-sensor motion capture glove calculated 23 joint angles from the hand and fingers across all movements for training regression models. For classifying across the 37 gestures, our decoding algorithm was able to differentiate between sequential movements with 97.3 ± 0.3 % accuracy calculated on a 100 ms bin-by-bin basis. In a separate mixed dataset consisting of 19 movements randomly interspersed, decoding performance achieved an average bin-wise accuracy of 92.8 ± 0.8 % . When evaluating decoders for use in real-time scenarios, we found that decoders can reliably decode both movements and movement transitions, achieving an average accuracy of 93.3 ± 0.9 % on the sequential set and 88.5 ± 0.9 % on the mixed set. Furthermore, we estimated continuous joint angles from the EMG sleeve data, achieving a R 2 of 0.884 ± 0.003 in the sequential set and 0.750 ± 0.008 in the mixed set. Median absolute error (MAE) was kept below 10° across all joints, with a grand average MAE of 1.8 ± 0 . 04 ∘ and 3.4 ± 0 . 07 ∘ for the sequential and mixed datasets, respectively. We also assessed two algorithm modifications to address specific challenges for EMG-driven HCI applications. To minimize decoder latency, we used a method that accounts for reaction time by dynamically shifting cue labels in time. To reduce training requirements, we show that pretraining models with historical data provided an increase in decoding performance compared with models that were not pretrained when reducing the in-session training data to only one attempt of each movement. The HD-EMG sleeve, combined with sophisticated machine learning algorithms, can be a powerful tool for hand gesture recognition and joint angle estimation. This technology holds significant promise for applications in HCI, such as prosthetics, assistive technology, rehabilitation, and human-robot collaboration.

An EMG-Based Deep Learning Approach for Multi-DOF Wrist Movement Decoding

Fast and Accurate Decoding of Finger Movements from ECoG Through Riemannian Features and Modern Machine Learning Techniques

Decoding Simultaneous Multi-DOF Wrist Movements From Raw EMG Signals Using a Convolutional Neural Network

A Deep Adaptive Framework for Robust Myoelectric Hand Movement Prediction

Decoding finger movement patterns from microscopic neural drive information based on deep learning

From Forearm to Wrist: Deep Learning for Surface Electromyography-Based Gesture Recognition.

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Robust neural decoding for dexterous control of robotic hand kinematics

Decoding of Multiple Wrist and Hand Movements Using a Transient EMG Classifier

Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation

Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control

Mapping Method of Human Arm Motion Based on Surface Electromyography Signals

Deep learning approach to control of prosthetic hands with electromyography signals

Proportional and Simultaneous Real-Time Control of the Full Human Hand From High-Density Electromyography

A Multi-DoF Prosthetic Hand Finger Joint Controller for Wearable sEMG Sensors by Nonlinear Autoregressive Exogenous Model

Non-Invasive Analysis of Motor Unit Activation During Simultaneous and Continuous Wrist Movements

Deep Neural Network Approach in EMG-Based Force Estimation for Human–Robot Interaction

Continuous Prediction of Wrist Joint Kinematics Using Surface Electromyography from the Perspective of Muscle Anatomy and Muscle Synergy Feature Extraction

On Muscle Selection for EMG Based Decoding of Dexterous, In-Hand Manipulation Motions

Simultaneous Control of Human Hand Joint Positions and Grip Force via HD-EMG and Deep Learning

A novel framework for designing a multi-DoF prosthetic wrist control using machine learning