Abstract:Maintaining the balance is always a challenge issue for bipedal humanoid robots in dealing with various locomotive tasks to serve human society, especially when the real environment the robot worked within exhibits to be very complex. Unlike plenty of previous successful approaches on humanoid balancing or push recovery, in this research, the Dynamical Movement Primitives (DMP) is employed to model several typical bio-inspired strategies. As humanoid balancing or push recovery could be regarded as a problem of how a robot to get back to its ongoing behavior when a break happens on account of external force or uneven terrain etc., the DMP model becomes an alternative ideal choice due to its promising nature of attractor. Meanwhile, the DMP composed of a set of differential equations provides a compact parameterized representation in modelling a motion strategy, and thus leads to a strategy model that is suitable to be fulfilled with machine learning techniques. In this research, the learning process for those bio-inspired strategies modeled with DMP are completed by adopting the stochastic policy gradient reinforcement learning and imitation learning separately. Furthermore, with Gaussian Process(GP) regression, push recovery strategies are generalized taking the advantages of the invariance properties of the DMP model. As a consequence, an online adaptive push recovery control strategy is finally achieved. Experimental results on both simulated robot and a real bipedal humanoid robot PKU-HR5 demonstrate the presented approach is effective and promising.

Humanoid Robot Push Recovery Through Foot Placement

Active Control Of Under-Actuated Foot Tilting For Humanoid Push Recovery

Push Recovery for the Standing Under-Actuated Bipedal Robot Using the Hip Strategy

Push Recovery for Humanoid Robots with Passive Damped Ankles

Biped Robot Push Detection and Recovery

Foot Placement Estimator for Quadruped Push Recovery

Standing Balance Control for Position Control-Based Humanoid Robot.

Stepping to recover: A 3D-LIPM based push recovery and fall management scheme for biped robots

Push Recovery of a Position-Controlled Humanoid Robot Based on Capture Point Feedback Control

Push Recovery Controller For Bipedal Robot Walking

Push Recovery of a Humanoid Robot Based on Model Predictive Control and Capture Point

Push Recovery Control Based on Model Predictive Control of Hydraulic Quadruped Robots

Balance Recovery Analysis With Constraints Of Feet-Ground For Biped Robot

Balance Recovery For Humanoid Robot In The Presence Of Unknown External Push

Learning Push Recovery for A Bipedal Humanoid Robot with Dynamical Movement Primitives

Enhancing Model-Based Step Adaptation for Push Recovery through Reinforcement Learning of Step Timing and Region

Push recovery with stepping strategy based on time-projection control

Flexible foot design for a humanoid robot

Anti-push Method of Biped Robot Based on Motion Capture Point and Reinforcement Learning

A Strategy For Push Recovery In Quadruped Robot Based On Reinforcement Learning

Reactive Stepping for Humanoid Robots using Reinforcement Learning: Application to Standing Push Recovery on the Exoskeleton Atalante