Regulation of LPA receptor function by estrogens.

A. González-Arenas,S. E. Avendaño-Vázquez,Alejandro Cabrera-Wrooman,Diana Tapia-Carrillo,F. Larrea,R. García-Becerra,J. García-Sáinz

DOI: https://doi.org/10.1016/j.bbamcr.2007.11.014

2008-02-01

Biochimica et Biophysica Acta

Abstract:

What problem does this paper attempt to address?

Control of Antagonistic McKibben Muscles Via a Bio-inspired Approach

Xinyi Chen,Wenxin Zhu,Wenyu Liang,Yilin Lang,Qinyuan Ren

DOI: https://doi.org/10.1007/s42235-022-00225-w

2022-01-01

Abstract:McKibben muscles are increasingly used in many robotic applications due to their advantages of lightweight, compliant, and skeletal muscles-like behaviours. However, there are still huge challenges in the motion control of McKibben muscles due to the system nonlinearity (e.g., hysteresis) and model uncertainties. To investigate the control issues, a soft artificial arm actuated by an antagonistic pair of McKibben muscles, mimicking the biological structure of skeleton-muscle systems, is developed. Inspired by the biological motor control capability that humans can control and coordinate a group of muscles to achieve complex motions, a cerebellum-like controller based on Spiking Neural Networks (SNNs) is employed for the motion control of the developed artificial arm. Benefit from the employment of the SNN-based cerebellar model, the proposed control scheme provides online adaptive learning capability, good computational efficiency, fast response, and strong robustness. Finally, several simulations and experiments are conducted subject to different environmental disturbances. Both simulation and experimental results verify that the proposed method can achieve good tracking performance, adaptability, and strong robustness.
Reinforcement Learning of Musculoskeletal Control from Functional Simulations

Emanuel Joos,Fabien Péan,Orcun Goksel

DOI: https://doi.org/10.48550/arXiv.2007.06669

IF: 4.729

2020-07-13

Signal Processing

Abstract:To diagnose, plan, and treat musculoskeletal pathologies, understanding and reproducing muscle recruitment for complex movements is essential. With muscle activations for movements often being highly redundant, nonlinear, and time dependent, machine learning can provide a solution for their modeling and control for anatomy-specific musculoskeletal simulations. Sophisticated biomechanical simulations often require specialized computational environments, being numerically complex and slow, hindering their integration with typical deep learning frameworks. In this work, a deep reinforcement learning (DRL) based inverse dynamics controller is trained to control muscle activations of a biomechanical model of the human shoulder. In a generalizable end-to-end fashion, muscle activations are learned given current and desired position-velocity pairs. A customized reward functions for trajectory control is introduced, enabling straightforward extension to additional muscles and higher degrees of freedom. Using the biomechanical model, multiple episodes are simulated on a cluster simultaneously using the evolving neural models of the DRL being trained. Results are presented for a single-axis motion control of shoulder abduction for the task of following randomly generated angular trajectories.
Semiparametric Musculoskeletal Model for Reinforcement Learning-Based Trajectory Tracking

Haoran Xu,Jianyin Fan,Hongxu Ma,Qiang Wang

DOI: https://doi.org/10.1109/tim.2024.3370760

IF: 5.6

2024-03-12

IEEE Transactions on Instrumentation and Measurement

Abstract:This article aims to solve the trajectory tracking task of the pneumatic musculoskeletal robot within a model-based reinforcement learning framework. Considering the limited sensors and short lifespan of self-made pneumatic artificial muscles, physics priors are encoded into Gaussian process regression to implement a semiparametric model for microdata system identification and the identified model is combined with cross-entropy method (CEM)-based model predictive control to plan for the optimal action online. To further compensate for the model imperfection and improve the control performance, a hybrid feedforward and feedback controller-like strategy is proposed to guide the search space of the original CEM solver. The effectiveness of our approach is verified on a real musculoskeletal manipulator with two degrees of freedom, and the results show that only 50 s of interacting with the environment is enough for the robot to learn writing alphabet letters from scratch.

engineering, electrical & electronic,instruments & instrumentation
From Rough to Precise: Human-Inspired Phased Target Learning Framework for Redundant Musculoskeletal Systems

Junjie Zhou,Jiahao Chen,Hu Deng,Hong Qiao

DOI: https://doi.org/10.3389/fnbot.2019.00061

2019-07-31

Abstract:Redundant muscles in human-like musculoskeletal robots provide additional dimensions to the solution space. Consequently, the computation of muscle excitations remains an open question. Conventional methods like dynamic optimization and reinforcement learning usually have high computational costs or unstable learning processes when applied to a complex musculoskeletal system. Inspired by human learning, we propose a phased target learning framework that provides different targets to learners at varying levels, to guide their training process and to avoid local optima. By introducing an extra layer of neurons reflecting a preference, we improve the Q-network method to generate continuous excitations. In addition, based on information transmission in the human nervous system, two kinds of biological noise sources are introduced into our framework to enhance exploration over the solution space. Tracking experiments based on a simplified musculoskeletal arm model indicate that under guidance of phased targets, the proposed framework prevents divergence of excitations, thus stabilizing training. Moreover, the enhanced exploration of solutions results in smaller motion errors. The phased target learning framework can be expanded for general-purpose reinforcement learning, and it provides a preliminary interpretation for modeling the mechanisms of human motion learning.
Scalable muscle-actuated human simulation and control

Seunghwan Lee,Moonseok Park,Kyoungmin Lee,Jehee Lee

DOI: https://doi.org/10.1145/3306346.3322972

IF: 6.2

2019-08-31

ACM Transactions on Graphics

Abstract:Many anatomical factors, such as bone geometry and muscle condition, interact to affect human movements. This work aims to build a comprehensive musculoskeletal model and its control system that reproduces realistic human movements driven by muscle contraction dynamics. The variations in the anatomic model generate a spectrum of human movements ranging from typical to highly stylistic movements. To do so, we discuss scalable and reliable simulation of anatomical features, robust control of under-actuated dynamical systems based on deep reinforcement learning, and modeling of pose-dependent joint limits. The key technical contribution is a scalable, two-level imitation learning algorithm that can deal with a comprehensive full-body musculoskeletal model with 346 muscles. We demonstrate the predictive simulation of dynamic motor skills under anatomical conditions including bone deformity, muscle weakness, contracture, and the use of a prosthesis. We also simulate various pathological gaits and predictively visualize how orthopedic surgeries improve post-operative gaits.

computer science, software engineering
Biomechanics-Aware Trajectory Optimization for Navigation during Robotic Physiotherapy

Italo Belli,J. Micah Prendergast,Ajay Seth,Luka Peternel

2024-11-06

Abstract:Robotic devices hold promise for aiding patients in orthopedic rehabilitation. However, current robotic-assisted physiotherapy methods struggle including biomechanical metrics in their control algorithms, crucial for safe and effective therapy. This paper introduces BATON, a Biomechanics-Aware Trajectory Optimization approach to robotic Navigation of human musculoskeletal loads. The method integrates a high-fidelity musculoskeletal model of the human shoulder into real-time control of robot-patient interaction during rotator cuff tendon rehabilitation. We extract skeletal dynamics and tendon loading information from an OpenSim shoulder model to solve an optimal control problem, generating strain-minimizing trajectories. Trajectories were realized on a healthy subject by an impedance-controlled robot while estimating the state of the subject's shoulder. Target poses were prescribed to design personalized rehabilitation across a wide range of shoulder motion avoiding high-strain areas. BATON was designed with real-time capabilities, enabling continuous trajectory replanning to address unforeseen variations in tendon strain, such as those from changing muscle activation of the subject.

Robotics,Systems and Control
Reinforcement Learning Control of a Biomechanical Model of the Upper Extremity

Florian Fischer,Miroslav Bachinski,Markus Klar,Arthur Fleig,Jörg Müller

DOI: https://doi.org/10.1038/s41598-021-93760-1

2022-04-20

Abstract:Among the infinite number of possible movements that can be produced, humans are commonly assumed to choose those that optimize criteria such as minimizing movement time, subject to certain movement constraints like signal-dependent and constant motor noise. While so far these assumptions have only been evaluated for simplified point-mass or planar models, we address the question of whether they can predict reaching movements in a full skeletal model of the human upper extremity. We learn a control policy using a motor babbling approach as implemented in reinforcement learning, using aimed movements of the tip of the right index finger towards randomly placed 3D targets of varying size. We use a state-of-the-art biomechanical model, which includes seven actuated degrees of freedom. To deal with the curse of dimensionality, we use a simplified second-order muscle model, acting at each degree of freedom instead of individual muscles. The results confirm that the assumptions of signal-dependent and constant motor noise, together with the objective of movement time minimization, are sufficient for a state-of-the-art skeletal model of the human upper extremity to reproduce complex phenomena of human movement, in particular Fitts' Law and the 2/3 Power Law. This result supports the notion that control of the complex human biomechanical system can plausibly be determined by a set of simple assumptions and can easily be learned.

Quantitative Methods,Human-Computer Interaction,Machine Learning,Robotics
Dietary folate and vitamin B12 intake before diagnosis decreases gastric cancer mortality risk among susceptible MTHFR 677TT carriers.

Marcia Galván-Portillo,L. Oñate-Ocaña,G. Perez-Perez,Jia Chen,R. Herrera-Goepfert,L. Chihu-Amparan,L. Flores-Luna,A. Mohar-Betancourt,L. López-Carrillo

DOI: https://doi.org/10.1016/j.nut.2009.05.006

2010-02-01

Abstract:
Learning Control Policies for Imitating Human Gaits

Utkarsh A. Mishra

DOI: https://doi.org/10.48550/arXiv.2106.15273

IF: 3.7

2021-05-15

Robotics

Abstract:The work presented in this report introduces a framework aimed towards learning to imitate human gaits. Humans exhibit movements like walking, running, and jumping in the most efficient manner, which served as the source of motivation for this project. Skeletal and Musculoskeletal human models were considered for motions in the sagittal plane, and results from both were compared exhaustively. While skeletal models are driven with motor actuation, musculoskeletal models perform through muscle-tendon actuation. Model-free reinforcement learning algorithms were used to optimize inverse dynamics control actions to satisfy the objective of imitating a reference motion along with secondary objectives of minimizing effort in terms of power spent by motors and metabolic energy consumed by the muscles. On the one hand, the control actions for the motor actuated model is the target joint angles converted into joint torques through a Proportional-Differential controller. While on the other hand, the control actions for the muscle-tendon actuated model is the muscle excitations converted implicitly to muscle activations and then to muscle forces which apply moments on joints. Muscle-tendon actuated models were found to have superiority over motor actuation as they are inherently smooth due to muscle activation dynamics and don't need any external regularizers. Finally, a strategy that was used to obtain an optimal configuration of the significant decision variables in the framework was discussed. All the results and analysis are presented in an illustrative, qualitative, and quantitative manner. Supporting video links are provided in the Appendix.
Sim: A goal-driven framework for elucidating the neural control of movement through musculoskeletal modeling

Muhammad Noman Almani,John Lazzari,Andrea Chacon,Shreya Saxena

DOI: https://doi.org/10.1101/2024.02.02.578628

2024-02-17

Abstract:How does the motor cortex (MC) produce purposeful and generalizable movements from the complex musculoskeletal system in a dynamic environment? To elucidate the underlying neural dynamics, we use a goal-driven approach to model MC by considering its goal as a controller driving the musculoskeletal system through desired states to achieve movement. Specifically, we formulate the MC as a recurrent neural network (RNN) controller producing muscle commands while receiving sensory feedback from biologically accurate musculoskeletal models. Given this real-time simulated feedback implemented in advanced physics simulation engines, we use deep reinforcement learning to train the RNN to achieve desired movements under specified neural and musculoskeletal constraints. Activity of the trained model can accurately decode experimentally recorded neural population dynamics and single-unit MC activity, while generalizing well to testing conditions significantly different from training. Simultaneous goal- and data-driven modeling in which we use the recorded neural activity as observed states of the MC further enhances direct and generalizable single-unit decoding. Finally, we show that this framework elucidates computational principles of how neural dynamics enable flexible control of movement and make this framework easy-to-use for future experiments.

Neuroscience
A memory and attention-based reinforcement learning for musculoskeletal robots with prior knowledge of muscle synergies

Xiaona Wang,Jiahao Chen,Hong Qiao

DOI: https://doi.org/10.1108/ria-11-2023-0172

2024-04-15

Abstract:Purpose Limited by the types of sensors, the state information available for musculoskeletal robots with highly redundant, nonlinear muscles is often incomplete, which makes the control face a bottleneck problem. The aim of this paper is to design a method to improve the motion performance of musculoskeletal robots in partially observable scenarios, and to leverage the ontology knowledge to enhance the algorithm’s adaptability to musculoskeletal robots that have undergone changes. Design/methodology/approach A memory and attention-based reinforcement learning method is proposed for musculoskeletal robots with prior knowledge of muscle synergies. First, to deal with partially observed states available to musculoskeletal robots, a memory and attention-based network architecture is proposed for inferring more sufficient and intrinsic states. Second, inspired by muscle synergy hypothesis in neuroscience, prior knowledge of a musculoskeletal robot’s muscle synergies is embedded in network structure and reward shaping. Findings Based on systematic validation, it is found that the proposed method demonstrates superiority over the traditional twin delayed deep deterministic policy gradients (TD3) algorithm. A musculoskeletal robot with highly redundant, nonlinear muscles is adopted to implement goal-directed tasks. In the case of 21-dimensional states, the learning efficiency and accuracy are significantly improved compared with the traditional TD3 algorithm; in the case of 13-dimensional states without velocities and information from the end effector, the traditional TD3 is unable to complete the reaching tasks, while the proposed method breaks through this bottleneck problem. Originality/value In this paper, a novel memory and attention-based reinforcement learning method with prior knowledge of muscle synergies is proposed for musculoskeletal robots to deal with partially observable scenarios. Compared with the existing methods, the proposed method effectively improves the performance. Furthermore, this paper promotes the fusion of neuroscience and robotics.
Local staging of anal and distal colorectal tumors with the magnetic resonance endoscope.

D. Kulling,David R. Feldman,Clive L. Kay,Daryl E. Bohning,B. Hoffman,A. van Velse,Paul L. Baron,Christopher J. Lahr,Robert H. Hawes

DOI: https://doi.org/10.1016/S0016-5107(98)70352-9

IF: 10.396

1998-02-01

Gastrointestinal Endoscopy

Abstract:
Acquiring musculoskeletal skills with curriculum-based reinforcement learning

Alberto Silvio Chiappa,Pablo Tano,Nisheet Patel,Abigaïl Ingster,Alexandre Pouget,Alexander Mathis

DOI: https://doi.org/10.1101/2024.01.24.577123

2024-01-25

Abstract:Efficient, physiologically-detailed musculoskeletal simulators and powerful learning algorithms provide new computational tools to tackle the grand challenge of understanding biological motor control. Our winning solution for the first NeurIPS MyoChallenge leverages an approach mirroring human learning and showcases reinforcement and curriculum learning as mechanisms to find motor control policies in complex object manipulation tasks. Analyzing the policy against data from human subjects reveals insights into efficient control of complex biological systems. Overall, our work highlights the new possibilities emerging at the interface of musculoskeletal physics engines, reinforcement learning and neuroscience.

Neuroscience
Proximal Policy Optimization With Time-Varying Muscle Synergy for the Control of an Upper Limb Musculoskeletal System

Rong Liu,Jiaxing Wang,Yaru Chen,Yin Liu,Yongxuan Wang,Jason Gu

DOI: https://doi.org/10.1109/tase.2023.3254583

IF: 6.636

2023-01-01

IEEE Transactions on Automation Science and Engineering

Abstract:Because of their unique adaptability, flexibility, and robustness, musculoskeletal robotic systems are regarded potentially as next-generation robots. However, motion learning and generation of such a robotic system are still challenging. This paper presents a neuromuscular control method, namely, TMS-PPO, based on time-varying muscle synergy (TMS) and proximal policy optimization (PPO). The electromyogram (EMG) activation signals of actual human motions are decomposed to obtain TMSs based on the temporal properties of the TMS. The weights of networks are trained to generate the scale and phase coefficients through the PPO. The coefficients modulate the TMSs to generate appropriate activation patterns to optimize motion learning of the musculoskeletal system. To verify the effectiveness of the proposed method, the TMSs are extracted from human upper limb muscle activation signals, and we compare TMS-PPO with PPO in the motion learning and generation process of an upper limb musculoskeletal system. The results show that TMS-PPO can complete the control tasks because the average errors of the joints are less than 0.05 rad. In the meantime, TMSs are used as motion primitives of the musculoskeletal system to simulate the process of the human CNS controlling muscles. It shows that TMS-PPO reduces the energy consumption and improves the learning rate significantly compared with the PPO. The learning episodes reduce from (10^4) to (10^3) , which indicates that TMS-PPO has a stronger learning ability and better physiological explanation. Note to Practitioners—Due to the superiorities of the musculoskeletal system, humanoid robots that imitate human driven mechanisms are vigorously carried out worldwide. Taking advantages of human-like characteristics, the musculoskeletal robot provides new opportunities to understand and validate the human mechanisms of muscle control and motion learning, to compare the performance of the robot to that of humans as well as work in real world, e.g., human interactive robots, amusement robots and medical training robots in the future. However, strong redundancy, coupling, and nonlinearity of the system also raises many challenges for the investigation of the control problem. Inspired by how the human CNS controls a musculoskeletal system and realize motion generalization, a novel muscle-synergies-based neuromuscular control that combines time-varying muscle synergy (TMS) and Proximal Policy Optimization (PPO), namely, TMS-PPO is proposed in this paper. The learning efficiency of PPO and the physiological interpretation of the control process are improved during the motion learning and generation processes of the musculoskeletal system. Preliminary simulation experiments suggest that this method is feasible in terms of control accuracy and efficiency. Moreover, the performance of the TMS-PPO is comparable to the PPO without significant improvement. To solve this problem, in future work, we will introduce the cerebellar model into the control method which plays the role of adjusting and correcting the motions of the limbs to achieve accurate and stable control in the actions process of humans.

automation & control systems
Learning Predictive Models for Ergonomic Control of Prosthetic Devices

Geoffrey Clark,Joseph Campbell,Heni Ben Amor

DOI: https://doi.org/10.48550/arXiv.2011.07005

IF: 3.7

2020-11-13

Robotics

Abstract:We present Model-Predictive Interaction Primitives -- a robot learning framework for assistive motion in human-machine collaboration tasks which explicitly accounts for biomechanical impact on the human musculoskeletal system. First, we extend Interaction Primitives to enable predictive biomechanics: the prediction of future biomechanical states of a human partner conditioned on current observations and intended robot control signals. In turn, we leverage this capability within a model-predictive control strategy to identify the future ergonomic and biomechanical ramifications of potential robot actions. Optimal control trajectories are selected so as to minimize future physical impact on the human musculoskeletal system. We empirically demonstrate that our approach minimizes knee or muscle forces via generated control actions selected according to biomechanical cost functions. Experiments are performed in synthetic and real-world experiments involving powered prosthetic devices.
A forward-inverse dynamics modeling framework for human musculoskeletal multibody system

Xinyue Wang,Jianqiao Guo,Qiang Tian

DOI: https://doi.org/10.1007/s10409-022-22140-x

2022-08-21

Acta Mechanica Sinica/Lixue Xuebao

Abstract:Multibody musculoskeletal modeling of human gait has been proved helpful in investigating the pathology of musculoskeletal disorders. However, conventional inverse dynamics methods rely on external force sensors and cannot capture the nonlinear muscle behaviors. Meanwhile, the forward dynamics approach is computationally demanding and only suited for relatively simple tasks. This study proposed an integrated simulation methodology to fulfill the requirements of estimating foot-ground reaction force, tendon elasticity, and muscle recruitment optimization. A hybrid motion capture system, which combines the marker-based infrared device and markerless tracking through deep convolutional neural networks, was developed to track lower limb movements. The foot-ground reaction forces were determined by a contact model for soft materials, and its parameters were estimated using a two-step optimization method. The muscle recruitment problem was first resolved via a static optimization algorithm, and the obtained muscle activations were used as initial values for further simulation. A torque tracking procedure was then performed by minimizing the errors of joint torques calculated by musculotendon equilibrium equations and inverse dynamics. The proposed approach was validated against the electromyography measurements of a healthy subject during gait. The simulation framework provides a robust way of predicting joint torques, musculotendon forces, and muscle activations, which can be beneficial for understanding the biomechanics of normal and pathological gait.
Muscle Excitation Estimation in Biomechanical Simulation Using NAF Reinforcement Learning

Amir H. Abdi,Pramit Saha,Venkata Praneeth Srungarapu,Sidney Fels

DOI: https://doi.org/10.1007/978-3-030-15923-8_11

2019-08-14

Abstract:Motor control is a set of time-varying muscle excitations which generate desired motions for a biomechanical system. Muscle excitations cannot be directly measured from live subjects. An alternative approach is to estimate muscle activations using inverse motion-driven simulation. In this article, we propose a deep reinforcement learning method to estimate the muscle excitations in simulated biomechanical systems. Here, we introduce a custom-made reward function which incentivizes faster point-to-point tracking of target motion. Moreover, we deploy two new techniques, namely episode-based hard update and dual buffer experience replay, to avoid feedback training loops. The proposed method is tested in four simulated 2D and 3D environments with 6–24 axial muscles. The results show that the models were able to learn muscle excitations for given motions after nearly 100,000 simulated steps. Moreover, the root mean square error in point-to-point reaching of the target across experiments was less than 1% of the length of the domain of motion. Our reinforcement learning method is far from the conventional dynamic approaches as the muscle control is derived functionally by a set of distributed neurons. This can open paths for neural activity interpretation of this phenomenon.
Neural-Learning Trajectory Tracking Control of Flexible-Joint Robot Manipulators with Unknown Dynamics

Shuyang Chen,John T. Wen

DOI: https://doi.org/10.48550/arXiv.1908.03269

2019-08-09

Abstract:Fast and precise motion control is important for industrial robots in manufacturing applications. However, some collaborative robots sacrifice precision for safety, particular for high motion speed. The performance degradation is caused by the inability of the joint servo controller to address the uncertain nonlinear dynamics of the robot arm, e.g., due to joint flexibility. We consider two approaches to improve the trajectory tracking performance through feedforward compensation. The first approach uses iterative learning control, with the gradient-based iterative update generated from the robot forward dynamics model. The second approach uses dynamic inversion to directly compensate for the robot forward dynamics. If the forward dynamics is strictly proper or is non-minimum-phase (e.g., due to time delays), its stable inverse would be non-causal. Both approaches require robot dynamical models. This paper presents results of using recurrent neural networks (RNNs) to approximate these dynamical models-forward dynamics in the first case, inverse dynamics (possibly non-causal) in the second case. We use the bi-directional RNN to capture the noncausality. The RNNs are trained based on a collection of commanded trajectories and the actual robot responses. We use a Baxter robot to evaluate the two approaches. The Baxter robot exhibits significant joint flexibility due to the series-elastic joint actuators. Both approaches achieve sizable improvement over the uncompensated robot motion, for both random joint trajectories and Cartesian motion. The inverse dynamics method is particularly attractive as it may be used to more accurately track a user input as in teleoperation.

Robotics
Real-Time Trajectory Optimization in Robot-Assisted Exercise and Rehabilitation

Humberto De las Casas,Nicholas Chambers,Hanz Richter,Kenneth Sparks

DOI: https://doi.org/10.48550/arXiv.2104.11273

2021-04-23

Abstract:This work focuses on the optimization of the training trajectory orientation using a robot as an advanced exercise machine (AEM) and muscle activations as biofeedback. Muscle recruitment patterns depend on trajectory parameters of the AEMs and correlate with the efficiency of exercise. Thus, improvements to training efficiency may be achieved by optimizing these parameters. The optimal regulation of these parameters is challenging because of the complexity of the physiological dynamics from person to person as a result of the unique physical features such as musculoskeletal distribution. Furthermore, these effects can vary due to fatigue, body temperature, and other physiological factors. In this paper, a model-free optimization method using Extremum Seeking Control (ESC) as a real-time optimizer is proposed. After selecting a muscle objective, this method seeks for the optimal combination of parameters using the muscle activations as biofeedback. The muscle objective can be selected by a therapist to emphasize or de-emphasize certain muscle groups. The feasibility of this method has been proven for the automatic regulation of an ellipsoidal curve orientation, suggesting the existence of two local optimal orientations. This methodology can also be applied to other parameter regulations using a different physiological effects such as oxygen consumption and heart rate as biofeedback.

Robotics
Optimizing wearable assistive devices with neuromuscular models and optimal control

Manish Sreenivasa,Matthew Millard,Paul Manns,Katja Mombaur

DOI: https://doi.org/10.48550/arXiv.1804.02959

2018-04-09

Abstract:The coupling of human movement dynamics with the function and design of wearable assistive devices is vital to better understand the interaction between the two. Advanced neuromuscular models and optimal control formulations provide the possibility to study and improve this interaction. In addition, optimal control can also be used to generate predictive simulations that generate novel movements for the human model under varying optimization criterion.

Robotics,Optimization and Control

Regulation of LPA receptor function by estrogens.

Control of Antagonistic McKibben Muscles Via a Bio-inspired Approach

Reinforcement Learning of Musculoskeletal Control from Functional Simulations

Semiparametric Musculoskeletal Model for Reinforcement Learning-Based Trajectory Tracking

From Rough to Precise: Human-Inspired Phased Target Learning Framework for Redundant Musculoskeletal Systems

Scalable muscle-actuated human simulation and control

Biomechanics-Aware Trajectory Optimization for Navigation during Robotic Physiotherapy

Reinforcement Learning Control of a Biomechanical Model of the Upper Extremity

Dietary folate and vitamin B12 intake before diagnosis decreases gastric cancer mortality risk among susceptible MTHFR 677TT carriers.

Learning Control Policies for Imitating Human Gaits

Sim: A goal-driven framework for elucidating the neural control of movement through musculoskeletal modeling

A memory and attention-based reinforcement learning for musculoskeletal robots with prior knowledge of muscle synergies

Local staging of anal and distal colorectal tumors with the magnetic resonance endoscope.

Acquiring musculoskeletal skills with curriculum-based reinforcement learning

Proximal Policy Optimization With Time-Varying Muscle Synergy for the Control of an Upper Limb Musculoskeletal System

Learning Predictive Models for Ergonomic Control of Prosthetic Devices

A forward-inverse dynamics modeling framework for human musculoskeletal multibody system

Muscle Excitation Estimation in Biomechanical Simulation Using NAF Reinforcement Learning

Neural-Learning Trajectory Tracking Control of Flexible-Joint Robot Manipulators with Unknown Dynamics

Real-Time Trajectory Optimization in Robot-Assisted Exercise and Rehabilitation

Optimizing wearable assistive devices with neuromuscular models and optimal control