Abstract:Surface electromyography (sEMG) is a non-invasive technique that measures the electrical activity generated by the muscles using sensors placed on the skin. It has been widely used in the field of prosthetics and other assistive systems because of the physiological connection between muscle electrical activity and movement dynamics. However, most existing sEMG-based decoding algorithms show a limited number of detectable degrees of freedom that can be proportionally and simultaneously controlled in real-time, which limits the use of EMG in a wide range of applications, including prosthetics and other consumer-level applications (e.g., human/machine interfacing). In this work, we propose a new deep learning method that can decode and map the electrophysiological activity of the forearm muscles into proportional and simultaneous control of > 20 degrees of freedom of the human hand with real-time resolution and with latency within the neuromuscular delays (< 50 ms). We recorded the kinematics of the human hand during grasping, pinching, individual digit movements and three gestures at slow (0.5 Hz) and fast (0.75 Hz) movement speeds in healthy participants. We demonstrate that our neural network can predict the kinematics of the hand in real-time at a constant 32 predictions per second. To achieve this, we employed transfer learning and created a prediction smoothing algorithm for the output of the neural network that reconstructed the full geometry of the hand in three-dimensional Cartesian space in real-time. Our results demonstrate that high-density EMG signals from the forearm muscles contain almost all the information that is needed to predict the kinematics of the human hand. The proposed method has the capability of predicting the full kinematics of the human hand with real-time resolution with immediate translational impact in subjects with motor impairments.

Multi-DoF Continuous Estimation for Wrist Torques Using Stacked Autoencoder

THE INFLUENCE OF TORQUE AND ELBOW POSITION ON WRIST ROTATE ANGLE RECOGNITION BASED SURFACE ELECTROMYOGRAM

A Multi-DoF Prosthetic Hand Finger Joint Controller for Wearable sEMG Sensors by Nonlinear Autoregressive Exogenous Model

An EMG-Based Deep Learning Approach for Multi-DOF Wrist Movement Decoding

Continuous Multi-DoF Wrist Kinematics Estimation Based on a Human-Machine Interface with Electrical-Impedance-Tomography

Functional Variable Selection for EMG-based Control of a Robotic Hand Prosthetic

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control

Continuous Estimation of Upper Limb Joint Angle from Semg Signals Based on SCA-LSTM Deep Learning Approach

Proportional and Simultaneous Real-Time Control of the Full Human Hand From High-Density Electromyography

Next Generation Network Service Architecture in the IP Multimedia Subsystem

Demonstration of improved beam quality in an image-rotating optical parametric oscillator.

Simultaneous estimation of grip force and wrist angles by surface electromyography and acceleration signals

Multi–Joint Angles Estimation of Forearm Motion Using a Regression Model

Wrist Torque Estimation via Electromyographic Motor Unit Decomposition and Image Reconstruction

Simultaneous estimation of 2-DOF wrist movements based on constrained non-negative matrix factorization and Hadamard product

Decoding Simultaneous Multi-DOF Wrist Movements From Raw EMG Signals Using a Convolutional Neural Network

Kinetic and Kinematic Sensors-free Approach for Estimation of Continuous Force and Gesture in sEMG Prosthetic Hands

Simultaneous Estimation of Digit Tip Forces and Hand Postures in a Simulated Real-Life Condition With High-Density Electromyography and Deep Learning

Simultaneous Control of Human Hand Joint Positions and Grip Force via HD-EMG and Deep Learning

Electromyography Based Cross-Subject Limb Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network