Abstract:Surface electromyography (sEMG) is a non-invasive technique that measures the electrical activity generated by the muscles using sensors placed on the skin. It has been widely used in the field of prosthetics and other assistive systems because of the physiological connection between muscle electrical activity and movement dynamics. However, most existing sEMG-based decoding algorithms show a limited number of detectable degrees of freedom that can be proportionally and simultaneously controlled in real-time, which limits the use of EMG in a wide range of applications, including prosthetics and other consumer-level applications (e.g., human/machine interfacing). In this work, we propose a new deep learning method that can decode and map the electrophysiological activity of the forearm muscles into proportional and simultaneous control of > 20 degrees of freedom of the human hand with real-time resolution and with latency within the neuromuscular delays (< 50 ms). We recorded the kinematics of the human hand during grasping, pinching, individual digit movements and three gestures at slow (0.5 Hz) and fast (0.75 Hz) movement speeds in healthy participants. We demonstrate that our neural network can predict the kinematics of the hand in real-time at a constant 32 predictions per second. To achieve this, we employed transfer learning and created a prediction smoothing algorithm for the output of the neural network that reconstructed the full geometry of the hand in three-dimensional Cartesian space in real-time. Our results demonstrate that high-density EMG signals from the forearm muscles contain almost all the information that is needed to predict the kinematics of the human hand. The proposed method has the capability of predicting the full kinematics of the human hand with real-time resolution with immediate translational impact in subjects with motor impairments.

Continuous Estimation Of Wrist Torques With Stack-Autoencoder Based Deep Neural Network: A Preliminary Study

Multi-DoF Continuous Estimation for Wrist Torques Using Stacked Autoencoder

THE INFLUENCE OF TORQUE AND ELBOW POSITION ON WRIST ROTATE ANGLE RECOGNITION BASED SURFACE ELECTROMYOGRAM

Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control

Surface Electromyography Image-Driven Torque Estimation of Multi-DoF Wrist Movements

Non-Invasive Analysis of Motor Unit Activation During Simultaneous and Continuous Wrist Movements

A Motor Unit-specific Images Based Scheme for Continuous Estimation of Wrist Torques - A Pilot Study

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Continuous Multi-DoF Wrist Kinematics Estimation Based on a Human-Machine Interface with Electrical-Impedance-Tomography

Wrist Torque Estimation via Electromyographic Motor Unit Decomposition and Image Reconstruction

An EMG-Based Deep Learning Approach for Multi-DOF Wrist Movement Decoding

Continuous Estimation of Upper Limb Joint Angle from Semg Signals Based on SCA-LSTM Deep Learning Approach

Graph-Driven Simultaneous and Proportional Estimation of Wrist Angle and Grasp Force Via High-Density EMG

Training Wrist Extensor Function and Detecting Unwanted Movement Strategies in an EMG-controlled Visuomotor Task.

A Practical and Adaptive Method to Achieve EMG-Based Torque Estimation for a Robotic Exoskeleton

Wrist Torque Estimation by Combining Motor Unit Discharges with Musculoskeletal Model

Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning

Kinetic and Kinematic Sensors-free Approach for Estimation of Continuous Force and Gesture in sEMG Prosthetic Hands

Proportional and Simultaneous Real-Time Control of the Full Human Hand From High-Density Electromyography

Simultaneous Estimation of Digit Tip Forces and Hand Postures in a Simulated Real-Life Condition With High-Density Electromyography and Deep Learning

Simultaneous Control of Human Hand Joint Positions and Grip Force via HD-EMG and Deep Learning