Abstract:Multisource biosignals are being increasingly used in human–machine interaction applications. In particular, a critical problem in exoskeleton-assisted rehabilitation for patients with hemiplegia is the generation of rhythmic and symmetrical locomotion. To support lower limb rehabilitation, we propose a model for predicting contralateral joint angles using multisource biosignals. First, a vibroarthrography (VAG) sensor is attached to the affected leg, and surface electromyography sensors are attached to the sound leg. The corresponding signals are used to estimate the hip, knee, and ankle joint angles of the affected leg. Second, an algorithm based on a temporal convolution network (TCN) is introduced to predict the contralateral lower-limb joint angles during human locomotion. The TCN is compared with a long short-term memory (LSTM) network and a convolutional neural network. Experiments were conducted by 10 healthy participants. The results of the proposed model were compared with measurements from encoders in three joints mounted on an exoskeleton to verify the applicability of the proposed model. In addition, by using the outputs of a motion capture system as the ground truth, the experimental results validated the model prediction performance. The prediction root mean square error (RMSE) of the TCN was 52%–70% lower than that of the LSTM network and CNN at different paces. The prediction RMSE using VAG was 20%–24% lower than that without using VAG. Note to Practitioners—We propose a model for predicting the contralateral lower-limb joint angles of an exoskeleton. The model uses measurements from multiple biosignal sensors to support exoskeleton-assisted hemiplegia rehabilitation. A sensing system based on acoustic signals and bioelectric signals is developed to improve the joint angle prediction in the affected- leg of patients with hemiplegia. A temporal convolution network is implemented to estimate joint angles, and training considering the root mean square error and Pearson correlation coefficient as evaluation indicators is performed. Unlike similar methods that include no sensory feedback from the affected leg, the proposed method incorporates VAG signals from the affected leg and sEMG signals from the sound leg to handle different degrees of hemiplegia and support the generation of rhythmic and symmetrical locomotion for gait rehabilitation using an exoskeleton.

Design of Exoskeleton Brain-Like Intelligent Trajectory Prediction Model Based on Echo State Network

A Brain-Inspired Decision-Making Method for Upper Limb Exoskeleton Based on Multi-Brain-Region Structure and Multimodal Information Fusion

Bionic Control of Exoskeleton Robot Based on Motion Intention for Rehabilitation Training.

Research on Control Method of Upper Limb Exoskeleton Based on Mixed Perception Model.

Motion intensity modeling and trajectory control of upper limb rehabilitation exoskeleton robot based on multi-modal information

Single-Layer Learning-Based Predictive Control with Echo State Network for Pneumatic-Muscle-Actuators-Driven Exoskeleton

Neuro-Mechanical Synergy: A Smart Idea of Intelligent Exoskeletons for Stroke Rehabilitation

Prediction of Contralateral Lower-Limb Joint Angles Using Vibroarthrography and Surface Electromyography Signals in Time-Series Network

Path Planning and Impedance Control of a Soft Modular Exoskeleton for Coordinated Upper Limb Rehabilitation

Synergetic gait prediction and compliant control of SEA-driven knee exoskeleton for gait rehabilitation

Control design of upper limb rehabilitation exoskeleton robot based on long and short-term memory network

Model-free Based Adaptive RBF Neural Network Control for a Rehabilitation Exoskeleton

Echo State Network-Enhanced Super-Twisting Control of Passive Gait Training Exoskeleton Driven by Pneumatic Muscles

Neural Network Based Modeling and Control of Elbow Joint Motion under Functional Electrical Stimulation

Modeling of Cortical Signals Using Echo State Networks

Motion Trajectories Prediction of Lower Limb Exoskeleton Based on Long Short-Term Memory (LSTM) Networks

A Real-Time Control Method for Upper Limb Exoskeleton Based on Active Torque Prediction Model.

A Novel Multimodal Human-Exoskeleton Interface Based on EEG and Semg Activity for Rehabilitation Training.

A Real-Time CNN-BiLSTM-based Classifier for Patient-Centered AR-SSVEP Active Rehabilitation Exoskeleton System

Lower Limb Joint Angle Prediction Based on Multistream Signaling and Quantile Regression, Temporal Convolution Network–Bidirectional Long Short-term Memory Network Neural Network

Modeling of Cortical Signals Using Optimized Echo State Networks with Leaky Integrator Neurons