Abstract:Reliable estimation of desired motion trajectories plays a crucial part in the continuous control of lower extremity assistance devices such as prostheses and orthoses. Moreover, reliable estimation methods are also required to predict hard-to-measure biomechanical quantities (e.g., joint contact moment/force) for use in sports injury science. Recognising that human locomotion is an inherently time-sequential and limb-synergetic behaviour, this study investigates models and learning algorithms for predicting the motion of a subject's leg from the motion of complementary limbs. The novel deep learning model architectures proposed are based on the Long Short-Term Memory approach with the addition of an attention mechanism. A dataset comprising Inertial Measurement Unit signals from 21 subjects traversing varied terrains was used, including stair ascent/descent, ramp ascent/descent, stopped, level-ground walking and the transitions between these conditions. Fourier Analysis is deployed to evaluate the model robustness, in addition to assessing time-based prediction errors. The experiment on three unseen test participants suggests that the branched neural network structure is preferred to tackle the multioutput problem, and the inclusion of an attention mechanism demonstrates improved performance in terms of accuracy, robustness and network size. An experimental comparison found that 57% of the model parameters were not needed after adding attention layers meanwhile the prediction error is lower than the LSTM model without attention mechanism. The attention model has errors of 9.06% and 7.64% (normalised root mean square error) for ankle and hip acceleration prediction respectively. Also, less high-frequency noise is present in the attention model predictions. We conclude that the internal structure of the proposed deep learning model is justified, principally the benefit of using an attention mechanism. Experimental results for biomechanical motion estimation are obtained, showing greater accuracy than only with LSTM. The trained attention model can be used throughout despite transitioning between terrain types. Such a model will be useful in, for example, the control of lower-limb prostheses, instead of the need to identify and switch between different trajectory generators for different walking modes.

Deep Learning for Motion Classification in Ankle Exoskeletons Using Surface EMG and IMU Signals

Ankle Foot Motion Recognition Based on Wireless Wearable Semg and Acceleration Sensors for Smart AFO

sEMG-Based Lower Limb Motion Prediction Using CNN-LSTM with Improved PCA Optimization Algorithm

Enhancing orthopedics and sports medicine with lower limb exoskeleton control in rehabilitation using deep learning based electromyography signal classification

Continuous Estimation of Human Knee Joint Angles by Fusing Kinematic and Myoelectric Signals

Continuous Intention Prediction of Lifting Motions Using EMG-Based CNN-LSTM

A deep learning method to predict ankle joint moment during walking at different speeds with ultrasound imaging: A framework for assistive devices control

Deep learning with an attention mechanism for continuous biomechanical motion estimation across varied activities

Improved Transfer Learning for Detecting Upper-Limb Movement Intention Using Mechanical Sensors in an Exoskeletal Rehabilitation System

Real-Time Human Activity Recognition with IMU and Encoder Sensors in Wearable Exoskeleton Robot via Deep Learning Networks

Real-Time Continuous Locomotion Mode Recognition and Transition Prediction for Human With Lower Limb Exoskeleton

A Motion Intent Recognition Method for Lower Limbs Based on CNN-RF Combined Model

A Novel Method for Detecting Misclassifications of the Locomotion Mode in Lower-Limb Exoskeleton Robot Control

A CNN-LSTM model for six human ankle movements classification on different loads

Continuous Prediction of Lower-Limb Kinematics From Multi-Modal Biomedical Signals

Recurrent Neural Network Enabled Continuous Motion Estimation of Lower Limb Joints From Incomplete sEMG Signals

A deep learning strategy for EMG-based joint position prediction in hip exoskeleton assistive robots

Deep ensemble learning approach for lower limb movement recognition from multichannel sEMG signals

EMG-Based Estimation of Limb Movement Using Deep Learning With Recurrent Convolutional Neural Networks.

An EMG-Based Deep Learning Approach for Multi-DOF Wrist Movement Decoding

Deep Learning to Predict Falls in Older Adults Based on Daily-Life Trunk Accelerometry