Abstract:Multisource biosignals are being increasingly used in human–machine interaction applications. In particular, a critical problem in exoskeleton-assisted rehabilitation for patients with hemiplegia is the generation of rhythmic and symmetrical locomotion. To support lower limb rehabilitation, we propose a model for predicting contralateral joint angles using multisource biosignals. First, a vibroarthrography (VAG) sensor is attached to the affected leg, and surface electromyography sensors are attached to the sound leg. The corresponding signals are used to estimate the hip, knee, and ankle joint angles of the affected leg. Second, an algorithm based on a temporal convolution network (TCN) is introduced to predict the contralateral lower-limb joint angles during human locomotion. The TCN is compared with a long short-term memory (LSTM) network and a convolutional neural network. Experiments were conducted by 10 healthy participants. The results of the proposed model were compared with measurements from encoders in three joints mounted on an exoskeleton to verify the applicability of the proposed model. In addition, by using the outputs of a motion capture system as the ground truth, the experimental results validated the model prediction performance. The prediction root mean square error (RMSE) of the TCN was 52%–70% lower than that of the LSTM network and CNN at different paces. The prediction RMSE using VAG was 20%–24% lower than that without using VAG. Note to Practitioners—We propose a model for predicting the contralateral lower-limb joint angles of an exoskeleton. The model uses measurements from multiple biosignal sensors to support exoskeleton-assisted hemiplegia rehabilitation. A sensing system based on acoustic signals and bioelectric signals is developed to improve the joint angle prediction in the affected- leg of patients with hemiplegia. A temporal convolution network is implemented to estimate joint angles, and training considering the root mean square error and Pearson correlation coefficient as evaluation indicators is performed. Unlike similar methods that include no sensory feedback from the affected leg, the proposed method incorporates VAG signals from the affected leg and sEMG signals from the sound leg to handle different degrees of hemiplegia and support the generation of rhythmic and symmetrical locomotion for gait rehabilitation using an exoskeleton.

Real-time Gait Trajectory Prediction Based on Convolutional Neural Network with Multi-head Attention

Motion Trajectories Prediction of Lower Limb Exoskeleton Based on Long Short-Term Memory (LSTM) Networks

Human Gait Prediction for Lower Limb Rehabilitation Exoskeleton Using Gated Recurrent Units

Gait Prediction Method of Lower Extremity Exoskeleton Based on SAE and LSTM Neural Network

Lower Limb Trajectory Prediction for Exoskeleton with AutoEncoder-Deep Gaussian Process

A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force

Convolutional Neural Network Model for Gait Classification of Flexible Lower Limb Exoskeleton

Personalized Gait Generation Using Convolutional Neural Network for Lower Limb Rehabilitation Robots

Research on human gait prediction and recognition algorithm of lower limb-assisted exoskeleton robot

Gait Neural Network for Human-Exoskeleton Interaction

Adaptive Gait Trajectory and Event Prediction of Lower Limb Exoskeletons for Various Terrains Using Reinforcement Learning

Prediction of Lower Limb Exoskeleton Gait Trajectories Based on Plantar Pressure Information

An Attention-Based CNN-LSTM Model with Limb Synergy for Joint Angles Prediction*

Gait Prediction and Variable Admittance Control for Lower Limb Exoskeleton with Measurement Delay and Extended-State-Observer

Continuous Prediction of Lower-Limb Kinematics From Multi-Modal Biomedical Signals

Auto-Correlation and Channel Attention Enhanced Deep Graph Convolution Networks for Gait Phase Prediction Based on Multi-IMU System

An ANN Based Approach for Gait Prediction of a Lower-Limb Exoskeleton with Plantar Pressure Sensors.

Individualized Gait Trajectory Prediction Based on Fusion LSTM Networks for Robotic Rehabilitation Training

Prediction of Contralateral Lower-Limb Joint Angles Using Vibroarthrography and Surface Electromyography Signals in Time-Series Network

Gait Intention Prediction Using a Lower-Limb Musculoskeletal Model and Long Short-Term Memory Neural Networks

Adaptive Gait Trajectory Based on Iterative Learning Control for Lower Extremity Rehabilitation Exoskeleton