Binding studies of a large antiviral polyamide to a natural HPV sequence.

Gaofei He,E. Vasilieva,G. D. Harris,K. Koeller,J. Bashkin,C. M. Dupureur

DOI: https://doi.org/10.1016/j.biochi.2014.02.011

IF: 4.372

2014-07-01

Biochimie

Abstract:

What problem does this paper attempt to address?

Three-Dimensional Human Modeling and Dynamics Simulation Based on ADAMS

Zhiwei Xu,Zirong Luo,Lei Ren,Kunyang Wang,Dan Hu

DOI: https://doi.org/10.1109/ihmsc.2017.191

2017-01-01

Abstract:In the field of biorobotics, a simple, high accuracy and programmable human walking simulation model are critically needed to investigate human walking mechanism, design bio-inspired robot and develop rehabilitation device. In this paper, we combine multibody dynamics and biomechanics to develop novel method for human walking modeling. Firstly, a human bone model with accurate anthropometric data is constructed based on reverse engineering to solve the problem that the human model is not accurate enough, and then the model motion data is obtained by human gait experiment to simulate the walking process in ADAMS. Finally, the walking simulation results used to verify the human walking model. We hope to provide a more efficient and accurate human modeling and walking simulation method for researchers in related fields.
Personalised 3D Human Digital Twin with Soft-Body Feet for Walking Simulation

Kum Yew Loke,Sherwin Stephen Chan,Mingyuan Lei,Henry Johan,Bingran Zuo,Wei Tech Ang

2024-11-22

Abstract:With the increasing use of assistive robots in rehabilitation and assisted mobility of human patients, there has been a need for a deeper understanding of human-robot interactions particularly through simulations, allowing an understanding of these interactions in a digital environment. There is an emphasis on accurately modelling personalised 3D human digital twins in these simulations, to glean more insights on human-robot interactions. In this paper, we propose to integrate personalised soft-body feet, generated using the motion capture data of real human subjects, into a skeletal model and train it with a walking control policy. Through evaluation using ground reaction force and joint angle results, the soft-body feet were able to generate ground reaction force results comparable to real measured data and closely follow joint angle results of the bare skeletal model and the reference motion. This presents an interesting avenue to produce a dynamically accurate human model in simulation driven by their own control policy while only seeing kinematic information during training.

Robotics
Inertia-Constrained Reinforcement Learning to Enhance Human Motor Control Modeling

Soroush Korivand,Nader Jalili,Jiaqi Gong

DOI: https://doi.org/10.3390/s23052698

IF: 3.9

2023-03-02

Sensors

Abstract:Locomotor impairment is a highly prevalent and significant source of disability and significantly impacts the quality of life of a large portion of the population. Despite decades of research on human locomotion, challenges remain in simulating human movement to study the features of musculoskeletal drivers and clinical conditions. Most recent efforts to utilize reinforcement learning (RL) techniques are promising in the simulation of human locomotion and reveal musculoskeletal drives. However, these simulations often fail to mimic natural human locomotion because most reinforcement strategies have yet to consider any reference data regarding human movement. To address these challenges, in this study, we designed a reward function based on the trajectory optimization rewards (TOR) and bio-inspired rewards, which includes the rewards obtained from reference motion data captured by a single Inertial Moment Unit (IMU) sensor. The sensor was equipped on the participants' pelvis to capture reference motion data. We also adapted the reward function by leveraging previous research on walking simulations for TOR. The experimental results showed that the simulated agents with the modified reward function performed better in mimicking the collected IMU data from participants, which means that the simulated human locomotion was more realistic. As a bio-inspired defined cost, IMU data enhanced the agent's capacity to converge during the training process. As a result, the models' convergence was faster than those developed without reference motion data. Consequently, human locomotion can be simulated more quickly and in a broader range of environments, with a better simulation performance.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Learning a Control Policy for Fall Prevention on an Assistive Walking Device

Visak C V Kumar,Sehoon Ha,Gergory Sawicki,C. Karen Liu

DOI: https://doi.org/10.48550/arXiv.1909.10488

2019-09-24

Abstract:Fall prevention is one of the most important components in senior care. We present a technique to augment an assistive walking device with the ability to prevent falls. Given an existing walking device, our method develops a fall predictor and a recovery policy by utilizing the onboard sensors and actuators. The key component of our method is a robust human walking policy that models realistic human gait under a moderate level of perturbations. We use this human walking policy to provide training data for the fall predictor, as well as to teach the recovery policy how to best modify the person's gait when a fall is imminent. Our evaluation shows that the human walking policy generates walking sequences similar to those reported in biomechanics literature. Our experiments in simulation show that the augmented assistive device can indeed help recover balance from a variety of external perturbations. We also provide a quantitative method to evaluate the design choices for an assistive device.

Robotics
Walking representation and simulation based on multi-source image fusion and multi-agent reinforcement learning for gait rehabilitation

Yean Zhu,Meirong Xiao,Dan Robbins,Xiaoying Wu,Wei Lu,Wensheng Hou

DOI: https://doi.org/10.1016/j.artmed.2024.102945

2024-08-13

Abstract:In the formulation of strategies for walking rehabilitation, achieving precise identification of the current state and making rational predictions about the future state are crucial but often unrealized. To tackle this challenge, our study introduces a unified framework that integrates a novel 3D walking motion capture method using multi-source image fusion and a walking rehabilitation simulation approach based on multi-agent reinforcement learning. We found that, (i) the proposal achieved an accurate 3D walking motion capture and outperforms other advanced methods. Experimental evidence indicates that, compared to similar visual skeleton tracking methods, the proposed approach yields results with higher Pearson correlation (r=0.93), intra-class correlation coefficient (ICC(2,1)=0.91), and narrower confidence intervals ([0.90,0.95] for r, [0.88,0.94] for ICC(2,1)) when compared to standard results. The outcomes of the proposed approach also exhibit commendable correlation and concurrence with those obtained through the IMU-based skeleton tracking method in the assessment of gait parameters ([0.85,0.89] for r, [0.75,0.81] for ICC(2,1)); (ii) multi-agent reinforcement learning has the potential to be used to solve the simulation task of gait rehabilitation. In mimicry experiment, our proposed simulation method for gait rehabilitation not only enables the intelligent agent to converge from the initial state to the target state, but also observes evolutionary patterns similar to those observed in clinical practice through motor state resolution. This study offers valuable contributions to walking rehabilitation, enabling precise assessment and simulation-based interventions, with potential implications for clinical practice and patient outcomes.
Reinforcement Learning Enabled Automatic Impedance Control of a Robotic Knee Prosthesis to Mimic the Intact Knee Motion in a Co-Adapting Environment

Ruofan Wu,Minhan Li,Zhikai Yao,Jennie Si,Huang

DOI: https://doi.org/10.48550/arXiv.2101.03487

2021-01-10

Abstract:Automatically configuring a robotic prosthesis to fit its user's needs and physical conditions is a great technical challenge and a roadblock to the adoption of the technology. Previously, we have successfully developed reinforcement learning (RL) solutions toward addressing this issue. Yet, our designs were based on using a subjectively prescribed target motion profile for the robotic knee during level ground walking. This is not realistic for different users and for different locomotion tasks. In this study for the first time, we investigated the feasibility of RL enabled automatic configuration of impedance parameter settings for a robotic knee to mimic the intact knee motion in a co-adapting environment. We successfully achieved such tracking control by an online policy iteration. We demonstrated our results in both OpenSim simulations and two able-bodied (AB) subjects.

Robotics,Systems and Control
Graceful User Following for Mobile Balance Assistive Robot in Daily Activities Assistance

Yifan Wang,Meng Yuan,Lei Li,Karen Sui Geok Chua,Seng Kwee Wee,Wei Tech Ang

2023-04-18

Abstract:Numerous diseases and aging can cause degeneration of people's balance ability resulting in limited mobility and even high risks of fall. Robotic technologies can provide more intensive rehabilitation exercises or be used as assistive devices to compensate for balance ability. However, With the new healthcare paradigm shifting from hospital care to home care, there is a gap in robotic systems that can provide care at home. This paper introduces Mobile Robotic Balance Assistant (MRBA), a compact and cost-effective balance assistive robot that can provide both rehabilitation training and activities of daily living (ADLs) assistance at home. A three degrees of freedom (3-DoF) robotic arm was designed to mimic the therapist arm function to provide balance assistance to the user. To minimize the interference to users' natural pelvis movements and gait patterns, the robot must have a Human-Robot Interface(HRI) that can detect user intention accurately and follow the user's movement smoothly and timely. Thus, a graceful user following control rule was proposed. The overall control architecture consists of two parts: an observer for human inputs estimation and an LQR-based controller with disturbance rejection. The proposed controller is validated in high-fidelity simulation with actual human trajectories, and the results successfully show the effectiveness of the method in different walking modes.

Robotics,Systems and Control
The Development of a Human Gait Model With Predictive Capability and the Simulation of Able-Bodied Gait

Jinming Sun,Shaoli Wu,Philip A. Voglewede

DOI: https://doi.org/10.1115/detc2015-47382

2015-08-02

Abstract:The development of current prostheses and orthoses typically follows a trial and error approach where the devices are designed based on experience, tried on human subjects and then redesigned iteratively. This design approach is costly, risky and time consuming. A predictive human gait model is desired such that prostheses can be virtually tested so that their performance can be predicted qualitatively, the cost can be reduced, and the risks can be minimized. The development of such a model is explained in this paper. The developed model includes two parts: a plant model which represents the forward dynamics of human gait and a controller which represents the central nervous system (CNS). The development of the plant model is explained in a different paper. This paper focuses on the control algorithm development and able-bodied gait simulation. The controller proposed in this paper utilizes model predictive control (MPC). MPC uses an internal model to predict the output in advance, compare the predicted output to the reference, and optimize control input so that the error between them is minimal. The developed predictive human gait model was validated by simulating able-bodied human gait. The simulation results showed that the controller is able to simulate the kinematic output close to experimental data.
Design and Control of an Omni-Directional Robotic Walker Based on Human–Machine Interaction

Jiancheng Ji,Wei Chen,Wenbin Wang,Jason Xi

DOI: https://doi.org/10.1109/access.2021.3103202

IF: 3.9

2021-01-01

IEEE Access

Abstract:A cornerstone of the rehabilitative regime for people diagnosed with dyskinesia is walking assist and gait training, however, prolonged care, provided by relatives or professionals, serves as a massive financial burden to patients. The proposed novel robotic walker seeks to address this concern. The walker incorporates human motion intention recognition to facilitate lower limb rehabilitation training and daily walking. The walker design places strong emphasis on patient safety and quality of life by providing omni-directional walking assist, four key pelvic motions that support hip rotations and comfortable body weight support (BWS). Additionally, five sensors were installed to identify the user’s motion intention from the interaction forces surrounding the pelvis and dead zone. Furthermore, Kalman filtering was used to guarantee the quality of the interactive signal while kinematic and dynamic models were derived to generate appropriate driving velocities to support patient’s body weight and improve mobility. To validate our design, the MATLAB simulations and exploratory clinical trials using healthy subjects were performed. Preliminary results demonstrate satisfactory kinematic performance and suggest the walker as a promising therapeutic avenue for individuals suffering from dyskinesia and other associated movement disorders.

computer science, information systems,telecommunications,engineering, electrical & electronic
Antigen focusing by specific monomeric immunoglobulin E bound to CD23 on Epstein-Barr virus-transformed B cells.

L. Santamaria,R. Bheekha,F. van Reijsen,M. T. Perez Soler,M. Suter,C. Bruijnzeel-Koomen,G. Mudde

DOI: https://doi.org/10.1016/0198-8859(93)90139-R

IF: 2.211

1993-05-01

Human Immunology

Abstract:
Policy Design for an Ankle-Foot Orthosis Using Simulated Physical Human–Robot Interaction via Deep Reinforcement Learning

J. Han,Jung-Hoon Kim,Ho Seon Choi,Jeong-Hoon Lee,Jongeun Choi

DOI: https://doi.org/10.1109/TNSRE.2022.3196468

IF: 4.9

2022-08-04

IEEE Transactions on Neural Systems and Rehabilitation Engineering

Abstract:This paper presents a novel approach for designing a robotic orthosis controller considering physical human-robot interaction (pHRI). Computer simulation for this human-robot system can be advantageous in terms of time and cost due to the laborious nature of designing a robot controller that effectively assists humans with the appropriate magnitude and phase. Therefore, we propose a two-stage policy training framework based on deep reinforcement learning (deep RL) to design a robot controller using human-robot dynamic simulation. In Stage 1, the optimal policy of generating human gaits is obtained from deep RL-based imitation learning on a healthy subject model using the musculoskeletal simulation in OpenSim-RL. In Stage 2, human models in which the right soleus muscle is weakened to a certain severity are created by modifying the human model obtained from Stage 1. A robotic orthosis is then attached to the right ankle of these models. The orthosis policy that assists walking with optimal torque is then trained on these models. Here, the elastic foundation model is used to predict the pHRI in the coupling part between the human and robotic orthosis. Comparative analysis of kinematic and kinetic simulation results with the experimental data shows that the derived human musculoskeletal model imitates a human walking. It also shows that the robotic orthosis policy obtained from two-stage policy training can assist the weakened soleus muscle. The proposed approach was validated by applying the learned policy to ankle orthosis, conducting a gait experiment, and comparing it with the simulation results.

Engineering,Medicine,Computer Science
Performance-based assistance control for robot-mediated upper-limbs rehabilitation

Leigang Zhang,Shuai Guo,Fengfeng Xi

DOI: https://doi.org/10.1016/j.mechatronics.2022.102919

IF: 3.379

2022-11-20

Mechatronics

Abstract:Clinical research results demonstrated that robot-mediated training for the recovery of subjects after the stroke had the benefit of being able to carry out high-intensity repetitive and task-oriented tasks, which could effectively facilitate the rehabilitation effect. However, these subjects may have different training requirements as the disability levels vary from subject to subject at different stages of rehabilitation. Therefore, to meet the rehabilitation training needs of subjects in different rehabilitation stages, a performance-based assistance control strategy for safe robot-mediated therapy is proposed in this paper. The strategy contains three training modes that are switched by the trajectory tracking error, the zero interaction force mode (ZIF), assist-as-needed (AAN) mode, and restriction interaction region (RIR) mode. In ZIF mode, the subject can freely refer to their motion trajectory, and the robot will only offer fixed assistance only when the subject is slacking. In AAN mode, the robot would offer a variable level of assistance force by adjusting the stiffness coefficient to assist subjects in accordance with their motor abilities. To assure safety, a sizable assisting force is applied in RIR mode. To validate and evaluate the effectiveness and performance of the proposed assistance control strategy, a set of task-oriented continuous movement experiments based on an end-effector robot-mediated training system were performed by five able-bodied subjects. The preliminary experiment results demonstrated that the proposed control strategy works properly and could provide corresponding assistance and adjust the working modes according to the subject's motor performance. It was found that the robot provided more assistance as the increasing trajectory tracking error led to a decrease in motor performance. Additionally, adaptive adjustment of the stiffness coefficient allowed the proposed assistance control strategy to induce more active effort. It's worth noting that the parameters of the proposed strategy may be personalized and adjusted for different subjects to satisfy various requirements.

robotics,automation & control systems,engineering, electrical & electronic, mechanical
Shared Autonomy Locomotion Synthesis With a Virtual Powered Prosthetic Ankle

Balint K Hodossy,Dario Farina

DOI: https://doi.org/10.1109/TNSRE.2023.3336713

Abstract:Virtual environments provide a safe and accessible way to test innovative technologies for controlling wearable robotic devices. However, to simulate devices that support walking, such as powered prosthetic legs, it is not enough to model the hardware without its user. Predictive locomotion synthesizers can generate the movements of a virtual user, with whom the simulated device can be trained or evaluated. We implemented a Deep Reinforcement Learning based motion controller in the MuJoCo physics engine, where autonomy over the humanoid model was shared between the simulated user and the control policy of an active prosthesis. Despite not optimising the controller to match experimental dynamics, realistic torque profiles and ground reaction force curves were produced by the agent. A data-driven and continuous representation of user intent was used to simulate a Human Machine Interface that controlled a transtibial prosthesis in a non-steady state walking setting. The continuous intent representation was shown to mitigate the need for compensatory gait patterns from their virtual users and halve the rate of tripping. Co-adaptation was identified as a potential challenge for training human-in-the-loop prosthesis control policies. The proposed framework outlines a way to explore the complex design space of robot-assisted gait, promoting the transfer of the next generation of intent driven controllers from the lab to real-life scenarios.
Multimodal fusion and human-robot interaction control of an intelligent robot

Tao Gong,Dan Chen,Guangping Wang,Weicai Zhang,Junqi Zhang,Zhongchuan Ouyang,Fan Zhang,Ruifeng Sun,Jiancheng Charles Ji,Wei Chen

DOI: https://doi.org/10.3389/fbioe.2023.1310247

IF: 5.7

2024-01-04

Frontiers in Bioengineering and Biotechnology

Abstract:Introduction: Small-scaled robotic walkers play an increasingly important role in Activity of Daily Living (ADL) assistance in the face of ever-increasing rehab requirements and existing equipment drawbacks. This paper proposes a Rehabilitation Robotic Walker (RRW) for walking assistance and body weight support (BWS) during gait rehabilitation. Methods: The walker provides the patients with weight offloading and guiding force to mimic a series of the physiotherapist’s (PT’s) movements, and creates a natural, comfortable, and safe environment. This system consists of an omnidirectional mobile platform, a BWS mechanism, and a pelvic brace to smooth the motions of the pelvis. To recognize the human intentions, four force sensors, two joysticks, and one depth-sensing camera were used to monitor the human-machine information, and a multimodal fusion algorithm for intention recognition was proposed to improve the accuracy. Then the system obtained the heading angle E, the pelvic pose F, and the motion vector H via the camera, the force sensors, and the joysticks respectively, classified the intentions with feature extraction and information fusion, and finally outputted the motor speed control through the robot’s kinematics. Results: To validate the validity of the algorithm above, a preliminary test with three volunteers was conducted to study the motion control. The results showed that the average error of the integral square error (ISE) was 2.90 and the minimum error was 1.96. Discussion: The results demonstrated the efficiency of the proposed method, and that the system is capable of providing walking assistance.

multidisciplinary sciences
Adaptive Admittance Control Scheme with Virtual Reality Interaction for Robot-Assisted Lower Limb Strength Training

Musong Lin,Hongbo Wang,Jianye Niu,Yu Tian,Xincheng Wang,Guowei Liu,Li Sun

DOI: https://doi.org/10.3390/machines9110301

IF: 2.899

2021-01-01

Machines

Abstract:Muscle weakness is the primary impairment causing mobility difficulty among stroke survivors. Millions of people are unable to live normally because of mobility difficulty every year. Strength training is an effective method to improve lower extremity ability but is limited by the shortage of medical staff. Thus, this paper proposes a robot-assisted active training (RAAT) by an adaptive admittance control scheme with virtual reality interaction (AACVRI). AACVRI consists of a stiffness variable admittance controller, an adaptive controller, and virtual reality (VR) interactions. In order to provide human-robot reality interactions corresponding to virtual scenes, an admittance control law with variable stiffness term was developed to define the mechanics property of the end effector. The adaptive controller improves tracking performances by compensating interaction forces and dynamics model deviations. A virtual training environment including action following, event feedback, and competition mechanism is utilized for improving boring training experience and engaging users to maintain active state in cycling training. To verify controller performances and the feasibility of RAAT, experiments were conducted with eight subjects. Admittance control provides desired variable interactions along the trajectory. The robot responds to different virtual events by changing admittance parameters according to trigger feedbacks. Adaptive control ensures tracking errors at a low level. Subjects were maintained in active state during this strength training. Their physiological signals significantly increased, and interaction forces were at a high level. RAAT is a feasible approach for lower limb strength training, and users can independently complete high-quality active strength training under RAAT.
Simulation of Assisted Human Walking Using Musculoskeletal Model Coupled with Exoskeleton Via Deep Reinforcement Learning

Ruiming Luo,Shouqian Sun

DOI: https://doi.org/10.1109/icccr49711.2021.9349390

2021-01-01

Abstract:This paper presents a novel approach to simulate assisted human walking to evaluate the assistance of the powered lower-limb exoskeleton. We first construct a subject specific musculoskeletal model as an agent that generates muscle forces according to internal and external states, and describe the exoskeleton as a rigid multi-link structure with compensatory torques applied at the joints. Then we train the agent to produce walking motion using a deep reinforcement learning algorithm given recorded experimental data on a biomechanical simulator. Next, we combine the pre-trained musculoskeletal agent with the exoskeleton and perform the assisted walking simulation which takes into account the human exoskeleton dynamics. Simulated energy expenditures under different experimental conditions are compared to evaluate the assistance effectiveness of the exoskeleton. Results show that the proposed method has great potential in providing insights into the human-exoskeleton interaction.
Model Predictive Control for Human-Centred Lower Limb Robotic Assistance

Christopher Caulcrick,Weiguang Huo,Enrico Franco,Samer Mohammed,Will Hoult,Ravi Vaidyanathan

DOI: https://doi.org/10.1109/tmrb.2021.3105141

2021-11-01

IEEE Transactions on Medical Robotics and Bionics

Abstract:Loss of mobility and/or balance resulting from neural trauma is a critical public health issue. Robotic exoskeletons hold great potential for rehabilitation and assisted movement. However, the synergy of robot operation with human effort remains a problem. In particular, optimal assist-as-needed (AAN) control remains unresolved given pathological variance among patients. We introduce a model predictive control (MPC) architecture for lower limb exoskeletons that achieves on-the-fly transitions between modes of assistance. The architecture implements a fuzzy logic algorithm (FLA) to map key modes of assistance based on human involvement. Three modes are utilised: passive, for human relaxed and robot dominant; active-assist, for human cooperation with the task; and safety, in the case of human resistance to the robot. Electromyography (EMG) signals are further employed to predict the human torque. EMG output is used by the MPC for trajectory following and by the FLA for decision making. Experimental validation using a 1-DOF knee exoskeleton demonstrates the controller tracking a sinusoidal trajectory with relaxed, assistive, and resistive operational modes. Results demonstrate rapid and appropriate transfers among the assistance modes, and satisfactory AAN performance in each case, offering a new level of human-robot synergy for mobility assist and rehabilitation.
Robust walking control of a lower limb rehabilitation exoskeleton coupled with a musculoskeletal model via deep reinforcement learning

Shuzhen Luo,Ghaith Androwis,Sergei Adamovich,Erick Nunez,Hao Su,Xianlian Zhou

DOI: https://doi.org/10.1186/s12984-023-01147-2

2023-03-19

Abstract:Background: Few studies have systematically investigated robust controllers for lower limb rehabilitation exoskeletons (LLREs) that can safely and effectively assist users with a variety of neuromuscular disorders to walk with full autonomy. One of the key challenges for developing such a robust controller is to handle different degrees of uncertain human-exoskeleton interaction forces from the patients. Consequently, conventional walking controllers either are patient-condition specific or involve tuning of many control parameters, which could behave unreliably and even fail to maintain balance. Methods: We present a novel, deep neural network, reinforcement learning-based robust controller for a LLRE based on a decoupled offline human-exoskeleton simulation training with three independent networks, which aims to provide reliable walking assistance against various and uncertain human-exoskeleton interaction forces. The exoskeleton controller is driven by a neural network control policy that acts on a stream of the LLRE's proprioceptive signals, including joint kinematic states, and subsequently predicts real-time position control targets for the actuated joints. To handle uncertain human interaction forces, the control policy is trained intentionally with an integrated human musculoskeletal model and realistic human-exoskeleton interaction forces. Two other neural networks are connected with the control policy network to predict the interaction forces and muscle coordination. To further increase the robustness of the control policy to different human conditions, we employ domain randomization during training that includes not only randomization of exoskeleton dynamics properties but, more importantly, randomization of human muscle strength to simulate the variability of the patient's disability. Through this decoupled deep reinforcement learning framework, the trained controller of LLREs is able to provide reliable walking assistance to patients with different degrees of neuromuscular disorders without any control parameter tuning. Results and conclusion: A universal, RL-based walking controller is trained and virtually tested on a LLRE system to verify its effectiveness and robustness in assisting users with different disabilities such as passive muscles (quadriplegic), muscle weakness, or hemiplegic conditions without any control parameter tuning. Analysis of the RMSE for joint tracking, CoP-based stability, and gait symmetry shows the effectiveness of the controller. An ablation study also demonstrates the strong robustness of the control policy under large exoskeleton dynamic property ranges and various human-exoskeleton interaction forces. The decoupled network structure allows us to isolate the LLRE control policy network for testing and sim-to-real transfer since it uses only proprioception information of the LLRE (joint sensory state) as the input. Furthermore, the controller is shown to be able to handle different patient conditions without the need for patient-specific control parameter tuning.
Imposing Healthy Hip Motion Pattern and Range by Exoskeleton Control for Individualized Assistance

Qiang Zhang,Varun Nalam,Xikai Tu,Minhan Li,Jennie Si,Michael D. Lewek,He Helen Huang

DOI: https://doi.org/10.1109/lra.2022.3196105

IF: 5.2

2022-10-01

IEEE Robotics and Automation Letters

Abstract:Powered exoskeletons are promising devices to improve the walking patterns of people with neurological impairments. Providing personalized external assistance though is challenging due to uncertainties and the time-varying nature of human-robot interaction. Recently, human-in-the-loop (HIL) optimization has been investigated for providing assistance to minimize energetic expenditure, usually quantified by metabolic cost. However, this full-body global effect evaluation may not directly reflect the local functions of the targeted joint(s). This makes it difficult to assess the direct effect when robotic assistance is provided. In addition, the HIL optimization method usually does not take into account local joint trajectories, a consideration that is important in imposing healthy joint movements and gait patterns for individuals with lower limb motor deficits. In this paper, we propose a model-free reinforcement learning (RL)-based control framework to achieve a normative range of motion and gait pattern of the hip joint during walking. Our RL-based control provides personalized assistance torque profile by heuristically manipulating three control parameters for hip flexion and extension, respectively, during walking. A least square policy iteration was devised to optimize a cost function associated with control efforts and hip joint trajectory errors by tuning the control parameters. To evaluate the performance of the design approach, a compression sleeve was used to constrain the hip joint of unimpaired human participants to simulate motor deficits. The proposed RL control successfully achieved the desired goal of enlarging the hip joint's range of motion in three participants walking on a treadmill.

robotics
Learning Bipedal Walking for Humanoids with Current Feedback

Rohan Pratap Singh,Zhaoming Xie,Pierre Gergondet,Fumio Kanehiro

DOI: https://doi.org/10.1109/ACCESS.2023.3301175

2023-08-07

Abstract:Recent advances in deep reinforcement learning (RL) based techniques combined with training in simulation have offered a new approach to developing robust controllers for legged robots. However, the application of such approaches to real hardware has largely been limited to quadrupedal robots with direct-drive actuators and light-weight bipedal robots with low gear-ratio transmission systems. Application to real, life-sized humanoid robots has been less common arguably due to a large sim2real gap. In this paper, we present an approach for effectively overcoming the sim2real gap issue for humanoid robots arising from inaccurate torque-tracking at the actuator level. Our key idea is to utilize the current feedback from the actuators on the real robot, after training the policy in a simulation environment artificially degraded with poor torque-tracking. Our approach successfully trains a unified, end-to-end policy in simulation that can be deployed on a real HRP-5P humanoid robot to achieve bipedal locomotion. Through ablations, we also show that a feedforward policy architecture combined with targeted dynamics randomization is sufficient for zero-shot sim2real success, thus eliminating the need for computationally expensive, memory-based network architectures. Finally, we validate the robustness of the proposed RL policy by comparing its performance against a conventional model-based controller for walking on uneven terrain with the real robot.

Robotics,Machine Learning

Binding studies of a large antiviral polyamide to a natural HPV sequence.

Three-Dimensional Human Modeling and Dynamics Simulation Based on ADAMS

Personalised 3D Human Digital Twin with Soft-Body Feet for Walking Simulation

Inertia-Constrained Reinforcement Learning to Enhance Human Motor Control Modeling

Learning a Control Policy for Fall Prevention on an Assistive Walking Device

Walking representation and simulation based on multi-source image fusion and multi-agent reinforcement learning for gait rehabilitation

Reinforcement Learning Enabled Automatic Impedance Control of a Robotic Knee Prosthesis to Mimic the Intact Knee Motion in a Co-Adapting Environment

Graceful User Following for Mobile Balance Assistive Robot in Daily Activities Assistance

The Development of a Human Gait Model With Predictive Capability and the Simulation of Able-Bodied Gait

Design and Control of an Omni-Directional Robotic Walker Based on Human–Machine Interaction

Antigen focusing by specific monomeric immunoglobulin E bound to CD23 on Epstein-Barr virus-transformed B cells.

Policy Design for an Ankle-Foot Orthosis Using Simulated Physical Human–Robot Interaction via Deep Reinforcement Learning

Performance-based assistance control for robot-mediated upper-limbs rehabilitation

Shared Autonomy Locomotion Synthesis With a Virtual Powered Prosthetic Ankle

Multimodal fusion and human-robot interaction control of an intelligent robot

Adaptive Admittance Control Scheme with Virtual Reality Interaction for Robot-Assisted Lower Limb Strength Training

Simulation of Assisted Human Walking Using Musculoskeletal Model Coupled with Exoskeleton Via Deep Reinforcement Learning

Model Predictive Control for Human-Centred Lower Limb Robotic Assistance

Robust walking control of a lower limb rehabilitation exoskeleton coupled with a musculoskeletal model via deep reinforcement learning

Imposing Healthy Hip Motion Pattern and Range by Exoskeleton Control for Individualized Assistance

Learning Bipedal Walking for Humanoids with Current Feedback