Abstract:Abstract Objective . Estimation of finger kinematics is an important function of an intuitive human–machine interface, such as gesture recognition. Here, we propose a novel deep learning method, named long exposure convolutional memory network (LE-ConvMN), and use it to proportionally estimate finger joint angles through surface electromyographic (sEMG) signals. Approach . We use a convolution structure to replace the neuron structure of traditional long short-term memory (LSTM) networks, and use the long exposure data structure which retains the spatial and temporal information of the electrodes as input. The Ninapro database, which contains continuous finger gestures and corresponding sEMG signals was used to verify the efficiency of the proposed deep learning method. The proposed method was compared with LSTM and Sparse Pseudo-input Gaussian Process (SPGP) on this database to predict the ten main joint angles on the hand based on sEMG. The correlation coefficient (CC) was evaluated using the three methods on eight healthy subjects, and all the methods adopted the root mean square (RMS) features. Main results. The experimental results showed that the average CC, root mean square error, normalized root mean square error of the proposed LE-ConvMN method (0.82 ± 0.03,11.54 ± 1.89,0.12 ± 0.013) was significantly higher than SPGP (0.65 ± 0.05, p < 0.001; 15.51 ± 2.82, p < 0.001; 0.16 ± 0.01, p < 0.001) and LSTM (0.64 ± 0.06, p < 0.001; 14.77 ± 3.21, p < 0.001; 0.15 ± 0.02, p = < 0.001). Furthermore, the proposed real-time-estimation method has a computation cost of only approximately 82 ms to output one state of ten joints (average value of 10 tests on TitanV GPU). Significance . The proposed LE-ConvMN method could efficiently estimate the continuous movement of fingers with sEMG, and its performance is significantly superior to two established deep learning methods.

Long Short Term Memory Model based Continuous Estimation of Human Finger Joint Angles

A Novel TCN-LSTM Hybrid Model for sEMG-Based Continuous Estimation of Wrist Joint Angles

Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals

THE INFLUENCE OF TORQUE AND ELBOW POSITION ON WRIST ROTATE ANGLE RECOGNITION BASED SURFACE ELECTROMYOGRAM

Semg-Based Continuous Estimation of Finger Kinematics Via Large-Scale Temporal Convolutional Network

Simultaneous and Proportional Estimation of Finger Joint Angles from Surface EMG Signals during Mirrored Bilateral Movements

Continuous Finger Kinematics Estimation Based on Semg and Attention-ConvGRU Network

Semg-Based Continuous Estimation of Grasp Movements by Long-Short Term Memory Network

Continuous Kalman Estimation Method for Finger Kinematics Tracking from Surface Electromyography

Finger Joint Angle Estimation Based on Motoneuron Discharge Activities

A Bi-Directional LSTM Network for Estimating Continuous Upper Limb Movement From Surface Electromyography

Continuous Estimation of Upper Limb Joint Angle from Semg Signals Based on SCA-LSTM Deep Learning Approach

Continuous Estimation of Human Joint Angles From sEMG Using a Multi-Feature Temporal Convolutional Attention-Based Network

Ensemble Learning Method for the Continuous Decoding of Hand Joint Angles

Accurate Continuous Prediction of 14 Degrees of Freedom of the Hand from Myoelectrical Signals through Convolutive Deep Learning

Motion estimation of elbow joint from sEMG using continuous wavelet transform and back propagation neural networks

Multi–Joint Angles Estimation of Forearm Motion Using a Regression Model

Continuous estimation of upper limb joint angle from sEMG based on multiple decomposition feature and BiLSTM network

A Multi-DoF Prosthetic Hand Finger Joint Controller for Wearable sEMG Sensors by Nonlinear Autoregressive Exogenous Model

Continuous Prediction of Wrist Joint Kinematics Using Surface Electromyography from the Perspective of Muscle Anatomy and Muscle Synergy Feature Extraction

Kinetic and Kinematic Sensors-free Approach for Estimation of Continuous Force and Gesture in sEMG Prosthetic Hands