Abstract:Multisource biosignals are being increasingly used in human–machine interaction applications. In particular, a critical problem in exoskeleton-assisted rehabilitation for patients with hemiplegia is the generation of rhythmic and symmetrical locomotion. To support lower limb rehabilitation, we propose a model for predicting contralateral joint angles using multisource biosignals. First, a vibroarthrography (VAG) sensor is attached to the affected leg, and surface electromyography sensors are attached to the sound leg. The corresponding signals are used to estimate the hip, knee, and ankle joint angles of the affected leg. Second, an algorithm based on a temporal convolution network (TCN) is introduced to predict the contralateral lower-limb joint angles during human locomotion. The TCN is compared with a long short-term memory (LSTM) network and a convolutional neural network. Experiments were conducted by 10 healthy participants. The results of the proposed model were compared with measurements from encoders in three joints mounted on an exoskeleton to verify the applicability of the proposed model. In addition, by using the outputs of a motion capture system as the ground truth, the experimental results validated the model prediction performance. The prediction root mean square error (RMSE) of the TCN was 52%–70% lower than that of the LSTM network and CNN at different paces. The prediction RMSE using VAG was 20%–24% lower than that without using VAG. Note to Practitioners—We propose a model for predicting the contralateral lower-limb joint angles of an exoskeleton. The model uses measurements from multiple biosignal sensors to support exoskeleton-assisted hemiplegia rehabilitation. A sensing system based on acoustic signals and bioelectric signals is developed to improve the joint angle prediction in the affected- leg of patients with hemiplegia. A temporal convolution network is implemented to estimate joint angles, and training considering the root mean square error and Pearson correlation coefficient as evaluation indicators is performed. Unlike similar methods that include no sensory feedback from the affected leg, the proposed method incorporates VAG signals from the affected leg and sEMG signals from the sound leg to handle different degrees of hemiplegia and support the generation of rhythmic and symmetrical locomotion for gait rehabilitation using an exoskeleton.

Measuring Method and Experiments of Knee Joint Moment of Assisted Exoskeleton Based on Neural Network

Intelligent Prediction of Human Lower Extremity Joint Moment: An Artificial Neural Network Approach

Performance of multiple neural networks in predicting lower limb joint moments using wearable sensors

A Long Short-Term Memory Neural Network Model for Knee Joint Acceleration Estimation Using Mechanomyography Signals

Continuous Estimation of Human Knee Joint Angles by Fusing Kinematic and Myoelectric Signals

Predicting Knee Joint Contact Forces During Normal Walking Using Kinematic Inputs with A Long-Short Term Neural Network

Ankle Moment Estimation Based on A Novel Distributed Plantar Pressure Sensing System

Semg-Based Joint Moment Estimation for Hip Exoskeleton General Assistive Strategy

A deep learning method to predict ankle joint moment during walking at different speeds with ultrasound imaging: A framework for assistive devices control

Fast Hip Joint Moment Estimation with A General Moment Feature Generation Method

Estimation of Muscle Forces of Lower Limbs Based on CNN–LSTM Neural Network and Wearable Sensor System

Prediction of Human Dynamic Ankle Moment Based on Surface Electromyography Signals.

Prediction of Contralateral Lower-Limb Joint Angles Using Vibroarthrography and Surface Electromyography Signals in Time-Series Network

Knee Angle Estimation from Surface EMG during Walking Using Attention-Based Deep Recurrent Neural Networks: Feasibility and Initial Demonstration in Cerebral Palsy

Motion Trajectories Prediction of Lower Limb Exoskeleton Based on Long Short-Term Memory (LSTM) Networks

Subject-Independent, Biological Hip Moment Estimation During Multimodal Overground Ambulation Using Deep Learning

Prediction of knee adduction moment using innovative instrumented insole and deep learning neural networks in healthy female individuals

Estimation of the Continuous Walking Angle of Knee and Ankle (Talocrural Joint, Subtalar Joint) of a Lower-Limb Exoskeleton Robot Using a Neural Network

Lower Limb Joint Torque Estimation by Neural Network and Sparse Gaussian Process with RIO Kernel

Artificial neural network-based control of powered knee exoskeletons for lifting tasks: design and experimental validation

Estimating human joint moments unifies exoskeleton control, reducing user effort