Abstract:Exoskeleton robot is an essential tool in active rehabilitation training for patients with lower limb motor dysfunctions. Accurate and real-time recognition in human motion intention is a great challenge in exoskeleton robot, which can be implemented by continues estimation of human joint angles. In this study, we innovatively proposed a novel feature-based convolutional neural network-bi-directional long-short term memory network (CNN-BiLSTM) model to predict the knee joint angles more accurately and in real time. We validated our method on a public dataset, including surface electromyography(sEMG) and inertial measurement unit (IMU) data of 10 healthy subjects during normal walking. Initially, features extraction from each modal data achieved feature-level fusion. Then the importance of each sEMG and IMU signal feature for knee joint angle prediction was quantified by ensemble feature scorer (EFS) and the number of features required for prediction while ensuring accuracy was simplified by profile likelihood maximization (PLM) algorithm. Finally, the CNN-BiLSTM model was created by using the determined simplest features to further fuse the spatio-temporal correlation of signals. The results indicated that the EFS and PLM algorithm could remove the feature redundancy perfectly and estimation performance would become better when bi-modal gait data were fused. For the estimation performance, the average root mean square error (RMSE), adjusted R-2 and pearson correlation coefficient (CC) of our algorithm were 4.07, 0.95, and 0.98, respectively, which was better than CNN, BiLSTM and other three traditional machine learning methods. In addition, the model test time was 62.47 +/- 0.29 ms, which was less than the predicted horizon of 100 ms. The real-time performance and accuracy are satisfactory. Compared with previous works, our method has great advantages in feature selection and model design, which further improves the prediction accuracy. These promising results demonstrate that the proposed method has considerable potential to be applied to exoskeleton robot control.

Real-Time Human Intention Recognition of Multi-Joints Based on MYO

Bp-AR-Based Human Joint Angle Estimation Using Multi-Channel Semg.

Neuro-Musculoskeletal Modeling for Online Estimation of Continuous Wrist Movements from Motor Unit Activities

A State-Space EMG Model for the Estimation of Continuous Joint Movements

An Enhanced EMG-driven Musculoskeletal Model Based on Non-Negative Matrix Factorization

Semg-Mmg State-Space Model for the Continuous Estimation of Multijoint Angle

A Temporally Smoothed MLP Regression Scheme for Continuous Knee/Ankle Angles Estimation by Using Multi-Channel Semg

Continuous Estimation of Human Joint Angles From sEMG Using a Multi-Feature Temporal Convolutional Attention-Based Network

Musculoskeletal Modeling Based on Muscle Synergy for Prediction of Hand and Wrist Movements

Simultaneous and Continuous Estimation of Joint Angles Based on Surface Electromyography State-Space Model

Extraction of elbow joint intention from sEMG signals in horizontal plane using cosine tuning functions

Continuous Estimation of the Lower-Limb Multi-Joint Angles Based on Muscle Synergy Theory and State-Space Model

Continuous Estimation of Human Knee Joint Angles by Fusing Kinematic and Myoelectric Signals

Continuous Online Prediction of Lower Limb Joints Angles Based on Semg Signals by Deep Learning Approach.

A Novel Method Based on Long Short Term Memory Network and Discrete-Time Zeroing Neural Algorithm for Upper-Limb Continuous Estimation Using Semg Signals

A Multi-Joint Continuous Motion Estimation Method of Lower Limb Using Least Squares Support Vector Machine and Zeroing Neural Network based on sEMG signals

Motion estimation of elbow joint from sEMG using continuous wavelet transform and back propagation neural networks

Analyzing Human Muscle State with Flexible Sensors

A Neural-Driven Musculoskeletal Model for Continuous Estimation of Hand and Wrist Movements

A Multi-DoF Prosthetic Hand Finger Joint Controller for Wearable sEMG Sensors by Nonlinear Autoregressive Exogenous Model

Simultaneous and Proportional Control of Wrist and Hand Movements Based on a Neural-Driven Musculoskeletal Model.