Abstract:Surface electromyography (sEMG) is a non-invasive technique that measures the electrical activity generated by the muscles using sensors placed on the skin. It has been widely used in the field of prosthetics and other assistive systems because of the physiological connection between muscle electrical activity and movement dynamics. However, most existing sEMG-based decoding algorithms show a limited number of detectable degrees of freedom that can be proportionally and simultaneously controlled in real-time, which limits the use of EMG in a wide range of applications, including prosthetics and other consumer-level applications (e.g., human/machine interfacing). In this work, we propose a new deep learning method that can decode and map the electrophysiological activity of the forearm muscles into proportional and simultaneous control of > 20 degrees of freedom of the human hand with real-time resolution and with latency within the neuromuscular delays (< 50 ms). We recorded the kinematics of the human hand during grasping, pinching, individual digit movements and three gestures at slow (0.5 Hz) and fast (0.75 Hz) movement speeds in healthy participants. We demonstrate that our neural network can predict the kinematics of the hand in real-time at a constant 32 predictions per second. To achieve this, we employed transfer learning and created a prediction smoothing algorithm for the output of the neural network that reconstructed the full geometry of the hand in three-dimensional Cartesian space in real-time. Our results demonstrate that high-density EMG signals from the forearm muscles contain almost all the information that is needed to predict the kinematics of the human hand. The proposed method has the capability of predicting the full kinematics of the human hand with real-time resolution with immediate translational impact in subjects with motor impairments.

A Study of Electromyogram Based on Human-Computer Interface

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control

EMG-Based Feature Extraction and Classification for Prosthetic Hand Control

EMG control of a 3-DOF anthropomorphic prosthetic hand

Classification of Human Hand Movements Using Surface EMG for Myoelectric Control.

EMG Signal Classification for Myoelectric Teleoperating a Dexterous Robot Hand

An EEG/EMG/EOG-Based Multimodal Human-Machine Interface to Real-Time Control of a Soft Robot Hand.

An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features

A Portable Artificial Robotic Hand Controlled by Emg Signal Using Ann Classifier

A Prosthetic Arm Based on EMG Pattern Recognition

Electromyography signals acquisition and real-time classification

Implementation of an Intelligent EMG Signal Classifier Using Open-Source Hardware

Human-Machine Interaction Control Based on Force Myograph and Electrical Stimulation Sensory Feedback for Multi-DOF Robotic Hand

Real-time Control Method for 3-DOF EMG Prosthetic Hand Based on DSP

Toward an Enhanced Human–Machine Interface for Upper-Limb Prosthesis Control with Combined EMG and NIRS Signals

Preliminary Study on Proportional and Simultaneous Estimation of Hand Posture Using Surface Emg Based on Synergy Concept

HAND RECOGNITION SYSTEM BASED ON ELECTROMYOGRAPHY FOR REAL-TIME HAND PROSTHETIC CONTROL

A Practical EEG-Based Human-Machine Interface to Online Control an Upper-Limb Assist Robot

A Preliminary Study Towards Prosthetic Hand Control Using Human Stereo-electroencephalography (SEEG) Signals

Proportional and Simultaneous Real-Time Control of the Full Human Hand From High-Density Electromyography