Abstract:High-density electromyography (HD-EMG) can provide a natural interface to enhance human-computer interaction (HCI). This study aims to demonstrate the capability of a novel HD-EMG forearm sleeve equipped with up to 150 electrodes to capture high-resolution muscle activity, decode complex hand gestures, and estimate continuous hand position via joint angle predictions. Ten able-bodied participants performed 37 hand movements and grasps while EMG was recorded using the HD-EMG sleeve. Simultaneously, an 18-sensor motion capture glove calculated 23 joint angles from the hand and fingers across all movements for training regression models. For classifying across the 37 gestures, our decoding algorithm was able to differentiate between sequential movements with 97.3 ± 0.3 % accuracy calculated on a 100 ms bin-by-bin basis. In a separate mixed dataset consisting of 19 movements randomly interspersed, decoding performance achieved an average bin-wise accuracy of 92.8 ± 0.8 % . When evaluating decoders for use in real-time scenarios, we found that decoders can reliably decode both movements and movement transitions, achieving an average accuracy of 93.3 ± 0.9 % on the sequential set and 88.5 ± 0.9 % on the mixed set. Furthermore, we estimated continuous joint angles from the EMG sleeve data, achieving a R 2 of 0.884 ± 0.003 in the sequential set and 0.750 ± 0.008 in the mixed set. Median absolute error (MAE) was kept below 10° across all joints, with a grand average MAE of 1.8 ± 0 . 04 ∘ and 3.4 ± 0 . 07 ∘ for the sequential and mixed datasets, respectively. We also assessed two algorithm modifications to address specific challenges for EMG-driven HCI applications. To minimize decoder latency, we used a method that accounts for reaction time by dynamically shifting cue labels in time. To reduce training requirements, we show that pretraining models with historical data provided an increase in decoding performance compared with models that were not pretrained when reducing the in-session training data to only one attempt of each movement. The HD-EMG sleeve, combined with sophisticated machine learning algorithms, can be a powerful tool for hand gesture recognition and joint angle estimation. This technology holds significant promise for applications in HCI, such as prosthetics, assistive technology, rehabilitation, and human-robot collaboration.

Adaptive and Personalized Gesture Recognition Using Textile Capacitive Sensor Arrays

Event-Driven Low-Power Gesture Recognition Using Differential Capacitance

Gesture Recognition Via Flexible Capacitive Touch Electrodes

A Wireless Multi-Channel Capacitive Sensor System for Efficient Glove-Based Gesture Recognition With AI at the Edge

Empowering Hand Rehabilitation with AI-Powered Gesture Recognition: A Study of an sEMG-Based System

A Flexible and Modular Body-Machine Interface for Individuals Living with Severe Disabilities

A Wearable Hand Rehabilitation System With Soft Gloves

A Flexible Iontronic Capacitive Sensing Array for Hand Gesture Recognition Using Deep Convolutional Neural Networks

Anatomically Designed Triboelectric Wristbands with Adaptive Accelerated Learning for Human–Machine Interfaces

Recognizing Complex Gestures on Minimalistic Knitted Sensors: Toward Real-World Interactive Systems

Real-Time Hand Gesture Tracking for Human–Computer Interface Based on Multi-Sensor Data Fusion

Static Hand Gesture Recognition Using Capacitive Sensing and Machine Learning

A Prosthetic Hand Body Area Controller Based on Efficient Pattern Recognition Control Strategies

Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation

A Robust Data-Driven Soft Sensory Glove for Human Hand Motions Identification and Replication

User-Tailored Hand Gesture Recognition System for Wearable Prosthesis and Armband Based on Surface Electromyogram

A Wearable Gesture Recognition System with Ultra-high Accuracy and Robustness Enabled by the Synergy of Multiple Fabric Sensing Devices

A Wearable and Portable Real-Time Control Gesture Recognition System for Bionic Manipulator

Implementation of Hand Gesture Recognition Device Applicable to Smart Watch Based on Flexible Epidermal Tactile Sensor Array

Sparse Wearable Sonomyography Sensor-based Proprioceptive Proportional Control Across Multiple Gestures

Low‐Cost Data Glove Based on Deep‐Learning‐Enhanced Flexible Multiwalled Carbon Nanotube Sensors for Real‐Time Gesture Recognition