Abstract:From the computational point of view, musculoskeletal control is the problem of controlling high degrees of freedom and dynamic multi-body system that is driven by redundant muscle units. A critical challenge in the control perspective of skeletal joints with antagonistic muscle pairs is finding methods robust to address this ill-posed nonlinear problem. To address this computational problem, we implemented a twofold optimization and learning framework to be specialized in addressing the redundancies in the muscle control . In the first part, we used model predictive control to obtain energy efficient skeletal trajectories to mimick human movements. The second part is to use deep reinforcement learning to obtain a sequence of stimulus to be given to muscles in order to obtain the skeletal trajectories with muscle control. We observed that the desired stimulus to muscles is only efficiently constructed by integrating the state and control input in a closed-loop setting as it resembles the proprioceptive integration in the spinal cord circuits. In this work, we showed how a variety of different reference trajectories can be obtained with optimal control and how these reference trajectories are mapped to the musculoskeletal control with deep reinforcement learning. Starting from the characteristics of human arm movement to obstacle avoidance experiment, our simulation results confirm the capabilities of our optimization and learning framework for a variety of dynamic movement trajectories. In summary, the proposed framework is offering a pipeline to complement the lack of experiments to record human motion-capture data as well as study the activation range of muscles to replicate the specific trajectory of interest. Using the trajectories from optimal control as a reference signal for reinforcement learning implementation has allowed us to acquire optimum and human-like behaviour of the musculoskeletal system which provides a framework to study human movement in-silico experiments. The present framework can also allow studying upper-arm rehabilitation with assistive robots given that one can use healthy subject movement recordings as reference to work on the control architecture of assistive robotics in order to compensate behavioural deficiencies. Hence, the framework opens to possibility of replicating or complementing labour-intensive, time-consuming and costly experiments with human subjects in the field of movement studies and digital twin of rehabilitation.

A Framework For Mode-Free Prosthetic Control For Unstructured Terrains

Adaptive Model Prediction Control-Based Multi-Terrain Trajectory Tracking Framework for Mobile Spherical Robots

Real-Time Continuous Locomotion Mode Recognition and Transition Prediction for Human With Lower Limb Exoskeleton

A novel framework for designing a multi-DoF prosthetic wrist control using machine learning

Shared Autonomy Locomotion Synthesis With a Virtual Powered Prosthetic Ankle

Powered Prosthesis Locomotion on Varying Terrains: Model-Dependent Control with Real-Time Force Sensing

Continual Imitation Learning for Prosthetic Limbs

On Predicting Transitions to Compliant Surfaces in Human Gait via Neural and Kinematic Signals

Modeling the Transitional Kinematics Between Variable-Incline Walking and Stair Climbing

Real-Time Hybrid Locomotion Mode Recognition for Lower Limb Wearable Robots

BPNN-Based Real-Time Recognition of Locomotion Modes for an Active Pelvis Orthosis with Different Assistive Strategies

Emulating Human Kinematic Behavior on Lower-Limb Prostheses via Multi-Contact Models and Force-Based Nonlinear Control

A Wearable Computer Vision System With Gimbal Enables Position-, Speed-, and Phase-Independent Terrain Classification for Lower Limb Prostheses

Optimum trajectory learning in musculoskeletal systems with model predictive control and deep reinforcement learning

Simultaneous Locomotion Mode Classification and Continuous Gait Phase Estimation for Transtibial Prostheses

Adaptive Gait Trajectory and Event Prediction of Lower Limb Exoskeletons for Various Terrains Using Reinforcement Learning

Adaptive Locomotion Transition Recognition with Wearable Sensors for Lower Limb Robotic Prosthesis

Learning a Shared Model for Motorized Prosthetic Joints to Predict Ankle-Joint Motion

Toward Controlling Transtibial Prostheses Using a Single Degree of Freedom Inertial Sensor System

Learning to Assist Different Wearers in Multitasks: Efficient and Individualized Human-In-the-Loop Adaption Framework for Exoskeleton Robots

A Framework for Planning and Controlling Non-Periodic Bipedal Locomotion