Abstract:In this research, we present an innovative method known as a physics-informed neural network (PINN) model to predict multi-joint kinematics using electromyography (EMG) signals recorded from the muscles surrounding these joints across various loads. The primary aim is to simultaneously predict both the shoulder and elbow joint angles while executing elbow flexion-extension (FE) movements, especially under varying load conditions. The PINN model is constructed by combining a feed-forward Artificial Neural Network (ANN) with a joint torque computation model. During the training process, the model utilizes a custom loss function derived from an inverse dynamics joint torque musculoskeletal model, along with a mean square angle loss. The training dataset for the PINN model comprises EMG and time data collected from four different subjects. To assess the model's performance, we conducted a comparison between the predicted joint angles and experimental data using a testing data set. The results demonstrated strong correlations of 58% to 83% in joint angle prediction. The findings highlight the potential of incorporating physical principles into the model, not only increasing its versatility but also enhancing its accuracy. The findings could have significant implications for the precise estimation of multi-joint kinematics in dynamic scenarios, particularly concerning the advancement of human-machine interfaces (HMIs) for exoskeletons and prosthetic control systems.

What problem does this paper attempt to address?

This paper aims to solve the problem of predicting upper - limb multi - joint kinematics using surface electromyography (sEMG), especially the challenge of simultaneously predicting shoulder and elbow joint angles under different load conditions. Specifically, the paper proposes a Physics - Informed Neural Network (PINN) model, which combines a Feed - Forward Artificial Neural Network (ANN) and a joint torque calculation model to improve the prediction accuracy and the generalization ability of the model. ### Main problems 1. **Multi - joint kinematics prediction**: How to accurately predict the kinematic parameters (such as joint angles) of multiple joints in the upper limb (especially the shoulder and elbow joints) under different load conditions from the electromyographic signals recorded on the muscle surface. 2. **Prediction under dynamic conditions**: How to maintain the prediction accuracy under different load conditions (such as no load, 2 kg, 4 kg, etc.). 3. **Physical consistency of the model**: How to introduce physical principles during the model training process so that it can not only accurately predict joint angles but also conform to the basic laws of biomechanics. ### Solutions - **PINN model**: The paper proposes a PINN model that combines a feed - forward neural network and physical constraints. This model incorporates physical principles (such as the inverse dynamics model) into the training process of the neural network through a custom loss function, thereby improving the prediction accuracy and the generalization ability of the model. - **Custom loss function**: A custom loss function is used in the training process of the model, which consists of two parts: - **Mean Square Angle Loss**: Used to measure the difference between the predicted joint angle and the actual joint angle. - **Physics Loss**: Based on the joint torque calculated by the inverse dynamics model, it ensures that the prediction results of the model conform to physical laws. - **Data set**: The training data set includes electromyographic signals and time data collected from four different subjects. The test data set is used to evaluate the performance of the model. ### Experimental results - **Prediction performance**: The experimental results show that the PINN model performs excellently in predicting joint angles, and the correlation coefficient between the predicted values and the actual values is between 58% and 83%. - **Dynamic tracking ability**: The model can accurately predict joint angles under different load conditions, demonstrating its strong dynamic tracking ability. - **Comparative analysis**: Compared with the traditional Feed - Forward Artificial Neural Network (ANN), the PINN model has a significant improvement in prediction accuracy and generalization ability. ### Potential applications - **Human - Machine Interface (HMI)**: This model can be used to develop more accurate human - machine interface systems, especially in the applications of exoskeleton and prosthetic control systems, enabling synchronous and proportional control of multiple degrees of freedom. - **Rehabilitation medicine**: In the field of rehabilitation medicine, this model can help doctors and therapists better understand the movement patterns of patients, thereby formulating more effective rehabilitation plans. In conclusion, this paper solves the problem of predicting upper - limb multi - joint kinematics using electromyographic signals under different load conditions by introducing a Physics - Informed Neural Network model, providing new ideas and methods for research and applications in related fields.

Predicting Multi-Joint Kinematics of the Upper Limb from EMG Signals Across Varied Loads with a Physics-Informed Neural Network

sEMG-Driven Physics-Informed Gated Recurrent Networks for Modeling Upper Limb Multi-Joint Movement Dynamics

A Feature-Encoded Physics-Informed Parameter Identification Neural Network for Musculoskeletal Systems

A multi-resolution physics-informed recurrent neural network: formulation and application to musculoskeletal systems

Ankle Joint Torque Prediction Using an NMS Solver Informed-ANN Model and Transfer Learning

Physics-informed Deep Learning for Musculoskeletal Modelling: Predicting Muscle Forces and Joint Kinematics from Surface EMG

A Physics-Informed Low-Shot Learning For sEMG-Based Estimation of Muscle Force and Joint Kinematics

Investigating Improvements to Neural Network Based EMG to Joint Torque Estimation

Prediction of joint moments using a neural network model of muscle activations from EMG signals

Physics-Informed Deep Learning for Muscle Force Prediction With Unlabeled sEMG Signals

Lower Limb Joint Torque Prediction Using Long Short-Term Memory Network and Gaussian Process Regression

A Pilot Study of Individual Muscle Force Prediction During Elbow Flexion and Extension in the Neurorehabilitation Field

Estimation of joint torques using an artificial neural network model based on kinematic and anthropometric data

Joint torque estimation for the human arm from sEMG using backpropagation neural networks and autoencoders

Exploring the contribution of joint angles and sEMG signals on joint torque prediction accuracy using LSTM-based deep learning techniques

MuscleNET: mapping electromyography to kinematic and dynamic biomechanical variables by machine learning

Continuous Prediction of Lower-Limb Kinematics From Multi-Modal Biomedical Signals

Simultaneous and Continuous Estimation of Shoulder and Elbow Kinematics from Surface EMG Signals

Joint torques prediction of a robotic arm using neural networks

Lower Limb Joint Torque Estimation by Neural Network and Sparse Gaussian Process with RIO Kernel

Intelligent Prediction of Human Lower Extremity Joint Moment: An Artificial Neural Network Approach