Abstract:Abstract Objective . Estimation of finger kinematics is an important function of an intuitive human–machine interface, such as gesture recognition. Here, we propose a novel deep learning method, named long exposure convolutional memory network (LE-ConvMN), and use it to proportionally estimate finger joint angles through surface electromyographic (sEMG) signals. Approach . We use a convolution structure to replace the neuron structure of traditional long short-term memory (LSTM) networks, and use the long exposure data structure which retains the spatial and temporal information of the electrodes as input. The Ninapro database, which contains continuous finger gestures and corresponding sEMG signals was used to verify the efficiency of the proposed deep learning method. The proposed method was compared with LSTM and Sparse Pseudo-input Gaussian Process (SPGP) on this database to predict the ten main joint angles on the hand based on sEMG. The correlation coefficient (CC) was evaluated using the three methods on eight healthy subjects, and all the methods adopted the root mean square (RMS) features. Main results. The experimental results showed that the average CC, root mean square error, normalized root mean square error of the proposed LE-ConvMN method (0.82 ± 0.03,11.54 ± 1.89,0.12 ± 0.013) was significantly higher than SPGP (0.65 ± 0.05, p < 0.001; 15.51 ± 2.82, p < 0.001; 0.16 ± 0.01, p < 0.001) and LSTM (0.64 ± 0.06, p < 0.001; 14.77 ± 3.21, p < 0.001; 0.15 ± 0.02, p = < 0.001). Furthermore, the proposed real-time-estimation method has a computation cost of only approximately 82 ms to output one state of ten joints (average value of 10 tests on TitanV GPU). Significance . The proposed LE-ConvMN method could efficiently estimate the continuous movement of fingers with sEMG, and its performance is significantly superior to two established deep learning methods.

Motion estimation of elbow joint from sEMG using continuous wavelet transform and back propagation neural networks

THE INFLUENCE OF TORQUE AND ELBOW POSITION ON WRIST ROTATE ANGLE RECOGNITION BASED SURFACE ELECTROMYOGRAM

Joint torque estimation for the human arm from sEMG using backpropagation neural networks and autoencoders

A Bi-Directional LSTM Network for Estimating Continuous Upper Limb Movement From Surface Electromyography

Continuous Estimation of Human Joint Angles From sEMG Using a Multi-Feature Temporal Convolutional Attention-Based Network

Knee Joint Angle Prediction Based on Muscle Synergy Theory and Generalized Regression Neural Network

Estimation of Upper Limb Joint Angle Using Surface EMG Signal

Simultaneous and Continuous Estimation of Shoulder and Elbow Kinematics from Surface EMG Signals

A Multi-Joint Continuous Motion Estimation Method of Lower Limb Using Least Squares Support Vector Machine and Zeroing Neural Network based on sEMG signals

Continuous estimation of upper limb joint angle from sEMG based on multiple decomposition feature and BiLSTM network

Long Short Term Memory Model based Continuous Estimation of Human Finger Joint Angles

SEMG-based multifeatures and predictive model for knee-joint-angle estimation

Continuous Estimation of Upper Limb Joint Angle from Semg Signals Based on SCA-LSTM Deep Learning Approach

Mapping Method of Human Arm Motion Based on Surface Electromyography Signals

Semg-Based Continuous Estimation of Finger Kinematics Via Large-Scale Temporal Convolutional Network

A Novel TCN-LSTM Hybrid Model for sEMG-Based Continuous Estimation of Wrist Joint Angles

Recurrent Neural Network Enabled Continuous Motion Estimation of Lower Limb Joints From Incomplete sEMG Signals

Estimation of Knee Joint Angle from Surface EMG Using Multiple Kernels Relevance Vector Regression

Investigating Improvements to Neural Network Based EMG to Joint Torque Estimation

Multi–Joint Angles Estimation of Forearm Motion Using a Regression Model

Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals