Abstract:Background: The underlying motivation of this work is to demonstrate that artificial muscle activity of known and unknown motion can be generated based on motion parameters, such as angular position, acceleration, and velocity of each joint (or the end-effector instead), which are similarly represented in our brains. This model is motivated by the known motion planning process in the central nervous system. That process incorporates the current body state from sensory systems and previous experiences, which might be represented as pre-learned inverse dynamics that generate associated muscle activity. Methods: We develop a novel approach utilizing recurrent neural networks that are able to predict muscle activity of the upper limbs associated with complex 3D human arm motions. Therefore, motion parameters such as joint angle, velocity, acceleration, hand position, and orientation, serve as input for the models. In addition, these models are trained on multiple subjects (n=5 including , 3 male in the age of 26±2 years) and thus can generalize across individuals. In particular, we distinguish between a general model that has been trained on several subjects, a subject-specific model, and a specific fine-tuned model using a transfer learning approach to adapt the model to a new subject. Estimators such as mean square error MSE, correlation coefficient r, and coefficient of determination R2 are used to evaluate the goodness of fit. We additionally assess performance by developing a new score called the zero-line score. The present approach was compared with multiple other architectures. Results: The presented approach predicts the muscle activity for previously through different subjects with remarkable high precision and generalizing nicely for new motions that have not been trained before. In an exhausting comparison, our recurrent network outperformed all other architectures. In addition, the high inter-subject variation of the recorded muscle activity was successfully handled using a transfer learning approach, resulting in a good fit for the muscle activity for a new subject. Conclusions: The ability of this approach to efficiently predict muscle activity contributes to the fundamental understanding of motion control. Furthermore, this approach has great potential for use in rehabilitation contexts, both as a therapeutic approach and as an assistive device. The predicted muscle activity can be utilized to guide functional electrical stimulation, allowing specific muscles to be targeted and potentially improving overall rehabilitation outcomes.

Learning Motor Cues in Brain-Muscle Modulation

Learning Shared Semantic Information from Multimodal Bio-signals for Brain-Muscle Modulation Analysis

Conditional Generative Models for Simulation of EMG During Naturalistic Movements

Identification of Neuromuscular Causal Relationship Between Brain and Muscles in Limb Movement by Using Ensemble Empirical Mode Decomposition based Causal Decomposition

The concepts of muscle activity generation driven by upper limb kinematics

A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

EMG Pattern Recognition via Bayesian Inference with Scale Mixture-Based Stochastic Generative Models

NeuroMotion: Open-source platform with neuromechanical and deep network modules to generate surface EMG signals during voluntary movement

An experimental and computational framework for modeling multi-muscle responses to transcranial magnetic stimulation of the human motor cortex

Extracting Neural Drives from Surface EMG: A Generative Model and Simulation Studies

A motor imagery classification model based on hybrid brain-computer interface and multitask learning of electroencephalographic and electromyographic deep features

Neurophysiological Analysis in Motor and Sensory Cortices for Improving Motor Imagination

Modular Organization of Muscle Synergies to Achieve Movement Behaviors.

Cortico-Muscular Coherence Analysis Under Voluntary, Stimulated And Imaginary Neuromuscular Activities

Mapping Motor Cortex Stimulation to Muscle Responses: A Deep Neural Network Modeling Approach

Bioinspired Gain-Modulated Recurrent Neural Network for Controlling Musculoskeletal Robot

Noise-assisted Multivariate Empirical Mode Decomposition Based Causal Decomposition for Detecting Upper Limb Movement in EEG-EMG Hybrid Brain Computer Interface

EMG-Based Continuous and Simultaneous Estimation of Arm Kinematics in Able-Bodied Individuals and Stroke Survivors

Modulating Inter-Muscular Coordination Patterns in the Upper Extremity Induces Changes to Inter-Muscular, Cortico-Muscular, and Cortico-Cortical Connectivity

Neuro-musculoskeletal modeling reveals muscle-level neural dynamics of adaptive learning in sensorimotor cortex

MuscleNET: mapping electromyography to kinematic and dynamic biomechanical variables by machine learning