Abstract:Estimation of vivo muscle forces during human motion is important for understanding human motion control mechanisms and joint mechanics. This paper combined the advantages of the convolutional neural network (CNN) and long-short-term memory (LSTM) and proposed a novel muscle force estimation method based on CNN–LSTM. A wearable sensor system was also developed to collect the angles and angular velocities of the hip, knee, and ankle joints in the sagittal plane during walking, and the collected kinematic data were used as the input for the neural network model. In this paper, the muscle forces calculated using OpenSim based on the Static Optimization (SO) method were used as the standard value to train the neural network model. Four lower limb muscles of the left leg, including gluteus maximus (GM), rectus femoris (RF), gastrocnemius (GAST), and soleus (SOL), were selected as the studying objects in this paper. The experiment results showed that compared to the standard CNN and the standard LSTM, the CNN–LSTM performed better in muscle forces estimation under slow (1.2 m/s), medium (1.5 m/s), and fast walking speeds (1.8 m/s). The average correlation coefficients between true and estimated values of four muscle forces under slow, medium, and fast walking speeds were 0.9801, 0.9829, and 0.9809, respectively. The average correlation coefficients had smaller fluctuations under different walking speeds, which indicated that the model had good robustness. The external testing experiment showed that the CNN–LSTM also had good generalization. The model performed well when the estimated object was not included in the training sample. This article proposed a convenient method for estimating muscle forces, which could provide theoretical assistance for the quantitative analysis of human motion and muscle injury. The method has established the relationship between joint kinematic signals and muscle forces during walking based on a neural network model; compared to the SO method to calculate muscle forces in OpenSim, it is more convenient and efficient in clinical analysis or engineering applications.

The bionic neural network for external simulation of human locomotor system

Physics-informed Deep Learning for Musculoskeletal Modelling: Predicting Muscle Forces and Joint Kinematics from Surface EMG

Physics-Informed Deep Learning for Musculoskeletal Modeling: Predicting Muscle Forces and Joint Kinematics from Surface EMG

Knowledge-Based Deep Learning for Time-Efficient Inverse Dynamics

Real-time calibration-free musculotendon kinematics for neuromusculoskeletal models

Physics-Informed Deep Learning for Muscle Force Prediction With Unlabeled sEMG Signals

A forward-inverse dynamics modeling framework for human musculoskeletal multibody system

Boosting Personalised Musculoskeletal Modelling with Physics-informed Knowledge Transfer

Boosting Personalized Musculoskeletal Modeling with Physics-Informed Knowledge Transfer

A Feature-Encoded Physics-Informed Parameter Identification Neural Network for Musculoskeletal Systems

A Neural Network Model for Efficient Musculoskeletal-Driven Skin Deformation

Toward Robust and Efficient Musculoskeletal Modeling Using Distributed Physics-Informed Deep Learning

A Physics-Informed Low-Shot Learning For sEMG-Based Estimation of Muscle Force and Joint Kinematics

Estimation of Muscle Forces of Lower Limbs Based on CNN–LSTM Neural Network and Wearable Sensor System

PerSival: Neural-network-based visualisation for pervasive continuum-mechanical simulations in musculoskeletal biomechanics

Predicting kinetics using musculoskeletal modeling and inertial motion capture

Neuro-Musculoskeletal Modeling for Online Estimation of Continuous Wrist Movements from Motor Unit Activities

A Pilot Study of Individual Muscle Force Prediction During Elbow Flexion and Extension in the Neurorehabilitation Field

A Subject-Specific Neuromusculoskeletal Model for Muscle Force Estimation Used in Rehabilitation

A multi-resolution physics-informed recurrent neural network: formulation and application to musculoskeletal systems

Integrating musculoskeletal simulation and machine learning: a hybrid approach for personalized ankle-foot exoskeleton assistance strategies