Abstract:Multisource biosignals are being increasingly used in human–machine interaction applications. In particular, a critical problem in exoskeleton-assisted rehabilitation for patients with hemiplegia is the generation of rhythmic and symmetrical locomotion. To support lower limb rehabilitation, we propose a model for predicting contralateral joint angles using multisource biosignals. First, a vibroarthrography (VAG) sensor is attached to the affected leg, and surface electromyography sensors are attached to the sound leg. The corresponding signals are used to estimate the hip, knee, and ankle joint angles of the affected leg. Second, an algorithm based on a temporal convolution network (TCN) is introduced to predict the contralateral lower-limb joint angles during human locomotion. The TCN is compared with a long short-term memory (LSTM) network and a convolutional neural network. Experiments were conducted by 10 healthy participants. The results of the proposed model were compared with measurements from encoders in three joints mounted on an exoskeleton to verify the applicability of the proposed model. In addition, by using the outputs of a motion capture system as the ground truth, the experimental results validated the model prediction performance. The prediction root mean square error (RMSE) of the TCN was 52%–70% lower than that of the LSTM network and CNN at different paces. The prediction RMSE using VAG was 20%–24% lower than that without using VAG. Note to Practitioners—We propose a model for predicting the contralateral lower-limb joint angles of an exoskeleton. The model uses measurements from multiple biosignal sensors to support exoskeleton-assisted hemiplegia rehabilitation. A sensing system based on acoustic signals and bioelectric signals is developed to improve the joint angle prediction in the affected- leg of patients with hemiplegia. A temporal convolution network is implemented to estimate joint angles, and training considering the root mean square error and Pearson correlation coefficient as evaluation indicators is performed. Unlike similar methods that include no sensory feedback from the affected leg, the proposed method incorporates VAG signals from the affected leg and sEMG signals from the sound leg to handle different degrees of hemiplegia and support the generation of rhythmic and symmetrical locomotion for gait rehabilitation using an exoskeleton.

ViT-LLMR: Vision Transformer-based lower limb motion recognition from fusion signals of MMG and IMU

ViT-HGR: Vision Transformer-based Hand Gesture Recognition from High Density Surface EMG Signals

Convolution‐enhanced vision transformer method for lower limb exoskeleton locomotion mode recognition

Enhance Decoding of Functional Lower-Limb Movements by Combining Sensory Motor Rhythm and Movement-Related Cortical Potential Features

Prediction of Lower Limb Action Intention Based on Surface EMG Signal

Gait-Event-Based human intention recognition approach for lower limb

Research on Multimodal Fusion Recognition Method of Upper Limb Motion Patterns

Prediction of Contralateral Lower-Limb Joint Angles Using Vibroarthrography and Surface Electromyography Signals in Time-Series Network

Human Motion Pattern Recognition and Feature Extraction: An Approach Using Multi-Information Fusion

Lower Limb Motion Recognition Based on sEMG and CNN-TL Fusion Model

A High‐Precision Dynamic Movement Recognition Algorithm Using Multimodal Biological Signals for Human–Machine Interaction

Electroencephalogram and surface electromyogram fusion-based precise detection of lower limb voluntary movement using convolution neural network-long short-term memory model

A Novel Transformer-Based Approach for Simultaneous Recognition of Hand Movements and Force Levels in Amputees Using Flexible Ultrasound Transducers

Real-time Continuous Recognition of Knee Motion Using Multi-Channel Mechanomyography Signals Detected on Clothes.

Analysis and Recognition of Human Lower Limb Motions Based on Electromyography (EMG) Signals

Real-time Recognition of Human Lower-Limb Locomotion Based on Exponential Coordinates of Relative Rotations

A Transformer-based Multi-task Learning Framework for Myoelectric Pattern Recognition Supporting Muscle Force Estimation

Motion Intent Recognition in Intelligent Lower Limb Prosthesis Using One-Dimensional Dual-Tree Complex Wavelet Transforms

Motion Intention Prediction and Joint Trajectories Generation Toward Lower Limb Prostheses Using EMG and IMU Signals

A Motion Intent Recognition Method for Lower Limbs Based on CNN-RF Combined Model

Mechanomyography signals processing method using multivariate variational mode decomposition