Abstract:Estimation of vivo muscle forces during human motion is important for understanding human motion control mechanisms and joint mechanics. This paper combined the advantages of the convolutional neural network (CNN) and long-short-term memory (LSTM) and proposed a novel muscle force estimation method based on CNN–LSTM. A wearable sensor system was also developed to collect the angles and angular velocities of the hip, knee, and ankle joints in the sagittal plane during walking, and the collected kinematic data were used as the input for the neural network model. In this paper, the muscle forces calculated using OpenSim based on the Static Optimization (SO) method were used as the standard value to train the neural network model. Four lower limb muscles of the left leg, including gluteus maximus (GM), rectus femoris (RF), gastrocnemius (GAST), and soleus (SOL), were selected as the studying objects in this paper. The experiment results showed that compared to the standard CNN and the standard LSTM, the CNN–LSTM performed better in muscle forces estimation under slow (1.2 m/s), medium (1.5 m/s), and fast walking speeds (1.8 m/s). The average correlation coefficients between true and estimated values of four muscle forces under slow, medium, and fast walking speeds were 0.9801, 0.9829, and 0.9809, respectively. The average correlation coefficients had smaller fluctuations under different walking speeds, which indicated that the model had good robustness. The external testing experiment showed that the CNN–LSTM also had good generalization. The model performed well when the estimated object was not included in the training sample. This article proposed a convenient method for estimating muscle forces, which could provide theoretical assistance for the quantitative analysis of human motion and muscle injury. The method has established the relationship between joint kinematic signals and muscle forces during walking based on a neural network model; compared to the SO method to calculate muscle forces in OpenSim, it is more convenient and efficient in clinical analysis or engineering applications.

Improved Fascicle Length Estimates From Ultrasound Using a U-net-LSTM Framework

A deep learning method to predict ankle joint moment during walking at different speeds with ultrasound imaging: A framework for assistive devices control

Estimation of absolute states of human skeletal muscle via standard B-mode ultrasound imaging and deep convolutional neural networks

Automatic extraction and measurement of ultrasonic muscle morphological parameters based on multi-stage fusion and segmentation

A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images

Automated Method for Tracking Human Muscle Architecture on Ultrasound Scans during Dynamic Tasks

SonoMyoNet: A Convolutional Neural Network for Predicting Isometric Force From Highly Sparse Ultrasound Images

Automatic Analysis of Transverse Musculoskeletal Ultrasound Images Based on the Multi-Task Learning Model

IFSS-Net: Interactive Few-Shot Siamese Network for Faster Muscle Segmentation and Propagation in Volumetric Ultrasound

Automated regional analysis of B-mode ultrasound images of skeletal muscle movement

Continuous Estimation of Human Knee Joint Angles by Fusing Kinematic and Myoelectric Signals

Estimation of Muscle Forces of Lower Limbs Based on CNN–LSTM Neural Network and Wearable Sensor System

Quantifying skeletal muscle structure parameters in ultrasound images using deep learning without linear assumptions

Automatic Tracking of Aponeuroses and Estimation of Muscle Thickness in Ultrasonography: a Feasibility Study.

Deep learning for the rapid automatic segmentation of forearm muscle boundaries from ultrasound datasets

A Hybrid Method for Ultrasound-Based Tracking of Skeletal Muscle Architecture

A Bi-Directional LSTM Network for Estimating Continuous Upper Limb Movement From Surface Electromyography

Deep Learning of Ultrasound Imaging for Evaluating Ambulatory Function of Individuals with Duchenne Muscular Dystrophy

Deep learning-based automatic pipeline for quantitative assessment of thigh muscle morphology and fatty infiltration

Continuous Estimation of Knee Joint Angle Based on Surface Electromyography Using a Long Short-Term Memory Neural Network and Time-Advanced Feature.

Innovative use of optical sensors for real-time imaging and diagnosis using enhanced verge denoising and LSTM for sports medicine