Abstract:Previous literature shows that deep learning is an effective tool to decode the motor intent from neural signals obtained from different parts of the nervous system. However, deep neural networks are often computationally complex and not feasible to work in real-time. Here we investigate different approaches' advantages and disadvantages to enhance the deep learning-based motor decoding paradigm's efficiency and inform its future implementation in real-time. Our data are recorded from the amputee's residual peripheral nerves. While the primary analysis is offline, the nerve data is cut using a sliding window to create a “pseudo-online” dataset that resembles the conditions in a real-time paradigm. First, a comprehensive collection of feature extraction techniques is applied to reduce the input data dimensionality, which later helps substantially lower the motor decoder's complexity, making it feasible for translation to a real-time paradigm. Next, we investigate two different strategies for deploying deep learning models: a one-step (1S) approach when big input data are available and a two-step (2S) when input data are limited. This research predicts five individual finger movements and four combinations of the fingers. The 1S approach using a recurrent neural network (RNN) to concurrently predict all fingers' trajectories generally gives better prediction results than all the machine learning algorithms that do the same task. This result reaffirms that deep learning is more advantageous than classic machine learning methods for handling a large dataset. However, when training on a smaller input data set in the 2S approach, which includes a classification stage to identify active fingers before predicting their trajectories, machine learning techniques offer a simpler implementation while ensuring comparably good decoding outcomes to the deep learning ones. In the classification step, either machine learning or deep learning models achieve the accuracy and F1 score of 0.99. Thanks to the classification step, in the regression step, both types of models result in a comparable mean squared error (MSE) and variance accounted for (VAF) scores as those of the 1S approach. Our study outlines the trade-offs to inform the future implementation of real-time, low-latency, and high accuracy deep learning-based motor decoder for clinical applications.

Robust neural decoding for dexterous control of robotic hand kinematics

Fast and Accurate Decoding of Finger Movements from ECoG Through Riemannian Features and Modern Machine Learning Techniques

Concurrent and Continuous Prediction of Finger Kinetics and Kinematics via Motoneuron Activities

Towards Efficient Neural Decoder for Dexterous Finger Force Predictions

Concurrent Prediction of Dexterous Finger Flexion and Extension Force via Deep Forest

Unsupervised neural decoding for concurrent and continuous multi-finger force prediction

Improving the Robustness of Human-Machine Interactive Control for Myoelectric Prosthetic Hand During Arm Position Changing

A portable, self-contained neuroprosthetic hand with deep learning-based finger control

Adaptive Neural Decoder for Prosthetic Hand Control

Proportional and Simultaneous Real-Time Control of the Full Human Hand From High-Density Electromyography

An EMG-Based Deep Learning Approach for Multi-DOF Wrist Movement Decoding

Deep learning approach to control of prosthetic hands with electromyography signals

Online Adaptation for Myographic Control of Natural Dexterous Hand and Finger Movements

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Decoding Grasp Movement from Monkey Premotor Cortex for Real-time Prothetic Hand Control

Effect of User Practice on Prosthetic Finger Control With an Intuitive Myoelectric Decoder

Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals

Deep Learning for Enhanced Prosthetic Control: Real-Time Motor Intent Decoding for Simultaneous Control of Artificial Limbs

Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning

Real-Time Brain-Machine Interface Achieves High-Velocity Prosthetic Finger Movements using a Biologically-Inspired Neural Network Decoder

Hardware-Efficient EMG Decoding for Next-Generation Hand Prostheses