Abstract:Natural control of assistive devices requires continuous positional encoding and decoding of the user's volition. Human movement is encoded by recruitment and rate coding of spinal motor units. Surface electromyography provides some information on the neural code of movement and is usually decoded into finger joint angles. However, the current approaches to mapping the electrical signal into joint angles are unsatisfactory. There are no methods that allow precise estimation of joint angles during natural hand movements within the large numbers of degrees of freedom of the hand. We propose a framework to train a neural network from digital cameras and high-density surface electromyography from the extrinsic (forearm and wrist) hand muscles. Furthermore, we show that our 3D convolutional neural network optimally predicted 14 functional flexion/extension joints of the hand. We found in our experiments (4 subjects; mean age of 26±2.12 years) that our model can predict individual sinusoidal finger movement at different speeds (0.5 and 1.5 Hz), as well as two and three finger pinching, and hand opening and closing, covering 14 degrees of freedom of the hand. Our deep learning method shows a mean absolute error of 2.78±0.28 degrees with a mean correlation coefficient between predicted and expected joint angles of 0.94, 95% confidence interval (CI) [0.81, 0.98] with simulated real-time inference times lower than 30 milliseconds. These results demonstrate that our approach is capable of predicting the user's volition similar to digital cameras through a non-invasive wearable neural interface. Clinical relevance- This method establishes a viable interface that can be used for both immersive virtual reality medical simulations environments and assistive devices such as exoskeleton and prosthetics.

Continuous Prediction of Human Joint Mechanics using EMG Signals: A Review of Model-based and Model-free Approaches

Continuous Prediction of Human Joint Mechanics using EMG Signals: A Review of Model-based and Model-free Approaches

Physics-informed Deep Learning for Musculoskeletal Modelling: Predicting Muscle Forces and Joint Kinematics from Surface EMG

Continuous Prediction of Wrist Joint Kinematics Using Surface Electromyography from the Perspective of Muscle Anatomy and Muscle Synergy Feature Extraction

Predicting Multi-Joint Kinematics of the Upper Limb from EMG Signals Across Varied Loads with a Physics-Informed Neural Network

SEMG-based multifeatures and predictive model for knee-joint-angle estimation

MuscleNET: mapping electromyography to kinematic and dynamic biomechanical variables by machine learning

Continuous Prediction of Lower-Limb Kinematics From Multi-Modal Biomedical Signals

Gait Cycle-Inspired Learning Strategy for Continuous Prediction of Knee Joint Trajectory from sEMG

Recurrent Neural Network Enabled Continuous Motion Estimation of Lower Limb Joints From Incomplete sEMG Signals

Gaussian Process Autoregression for Joint Angle Prediction Based on sEMG Signals

Knee Joint Angle Prediction Based on Muscle Synergy Theory and Generalized Regression Neural Network

A complete process for human dynamics analysis including parameter identification and sEMG-torque estimation

Continuous Intention Prediction of Lifting Motions Using EMG-Based CNN-LSTM

Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning

Prediction of Human Voluntary Torques Based on Collaborative Neuromusculoskeletal Modeling and Adaptive Learning

Machine Learning Approaches for 3D Motion Synthesis and Musculoskeletal Dynamics Estimation: A Survey

A Dual-Modal Approach Using Electromyography and Sonomyography Improves Prediction of Dynamic Ankle Movement: A Case Study

Integrating modelling and experiments to assess dynamic musculoskeletal function in humans

Predicting kinetics using musculoskeletal modeling and inertial motion capture

A Bi-Directional LSTM Network for Estimating Continuous Upper Limb Movement From Surface Electromyography