Abstract:Exoskeleton robot is an essential tool in active rehabilitation training for patients with lower limb motor dysfunctions. Accurate and real-time recognition in human motion intention is a great challenge in exoskeleton robot, which can be implemented by continues estimation of human joint angles. In this study, we innovatively proposed a novel feature-based convolutional neural network-bi-directional long-short term memory network (CNN-BiLSTM) model to predict the knee joint angles more accurately and in real time. We validated our method on a public dataset, including surface electromyography(sEMG) and inertial measurement unit (IMU) data of 10 healthy subjects during normal walking. Initially, features extraction from each modal data achieved feature-level fusion. Then the importance of each sEMG and IMU signal feature for knee joint angle prediction was quantified by ensemble feature scorer (EFS) and the number of features required for prediction while ensuring accuracy was simplified by profile likelihood maximization (PLM) algorithm. Finally, the CNN-BiLSTM model was created by using the determined simplest features to further fuse the spatio-temporal correlation of signals. The results indicated that the EFS and PLM algorithm could remove the feature redundancy perfectly and estimation performance would become better when bi-modal gait data were fused. For the estimation performance, the average root mean square error (RMSE), adjusted R-2 and pearson correlation coefficient (CC) of our algorithm were 4.07, 0.95, and 0.98, respectively, which was better than CNN, BiLSTM and other three traditional machine learning methods. In addition, the model test time was 62.47 +/- 0.29 ms, which was less than the predicted horizon of 100 ms. The real-time performance and accuracy are satisfactory. Compared with previous works, our method has great advantages in feature selection and model design, which further improves the prediction accuracy. These promising results demonstrate that the proposed method has considerable potential to be applied to exoskeleton robot control.

Electromyography Based Cross-Subject Limb Angle Estimation via Hierarchical Spiking Attentional Feature Decomposition Network

Continuous Estimation of Human Joint Angles From sEMG Using a Multi-Feature Temporal Convolutional Attention-Based Network

Gesture Classification in Electromyography Signals for Real-Time Prosthetic Hand Control Using a Convolutional Neural Network-Enhanced Channel Attention Model

Continuous Estimation of Upper Limb Joint Angle Based on Stacked Denoising Autoencoder

Continuous Estimation of Human Knee Joint Angles by Fusing Kinematic and Myoelectric Signals

Continuous and Simultaneous Estimation of Lower Limb Multi-Joint Angles from Semg Signals Based on Stacked Convolutional and LSTM Models

Continuous Estimation of Upper Limb Joint Angle from Semg Signals Based on SCA-LSTM Deep Learning Approach

A Temporally Smoothed MLP Regression Scheme for Continuous Knee/Ankle Angles Estimation by Using Multi-Channel Semg

SEMG-based multifeatures and predictive model for knee-joint-angle estimation

Semg-Based Consecutive Estimation Of Human Lower Limb Movement By Using Multi-Branch Neural Network

Multi-Attention Feature Fusion Network for Accurate Estimation of Finger Kinematics from Surface Electromyographic Signals

Continuous Estimation of the Lower-Limb Multi-Joint Angles Based on Muscle Synergy Theory and State-Space Model

A Novel Hybrid Unsupervised Domain Adaptation Method for Cross-subject Joint Angle Estimation from Surface Electromyography

SpGesture: Source-Free Domain-adaptive sEMG-based Gesture Recognition with Jaccard Attentive Spiking Neural Network

Cross-Subject Lifelong Learning for Continuous Estimation From Surface Electromyographic Signal

Multimodal Human-Exoskeleton Interface for Lower Limb Movement Prediction Through a Dense Co-Attention Symmetric Mechanism.

Continuous Estimation of Knee Joint Angle Based on Surface Electromyography Using a Long Short-Term Memory Neural Network and Time-Advanced Feature.

A Novel Multimodal Human-Exoskeleton Interface Based on EEG and Semg Activity for Rehabilitation Training.

Multi-DoF Continuous Estimation for Wrist Torques Using Stacked Autoencoder

Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals