Abstract:Maintaining the balance is always a challenge issue for bipedal humanoid robots in dealing with various locomotive tasks to serve human society, especially when the real environment the robot worked within exhibits to be very complex. Unlike plenty of previous successful approaches on humanoid balancing or push recovery, in this research, the Dynamical Movement Primitives (DMP) is employed to model several typical bio-inspired strategies. As humanoid balancing or push recovery could be regarded as a problem of how a robot to get back to its ongoing behavior when a break happens on account of external force or uneven terrain etc., the DMP model becomes an alternative ideal choice due to its promising nature of attractor. Meanwhile, the DMP composed of a set of differential equations provides a compact parameterized representation in modelling a motion strategy, and thus leads to a strategy model that is suitable to be fulfilled with machine learning techniques. In this research, the learning process for those bio-inspired strategies modeled with DMP are completed by adopting the stochastic policy gradient reinforcement learning and imitation learning separately. Furthermore, with Gaussian Process(GP) regression, push recovery strategies are generalized taking the advantages of the invariance properties of the DMP model. As a consequence, an online adaptive push recovery control strategy is finally achieved. Experimental results on both simulated robot and a real bipedal humanoid robot PKU-HR5 demonstrate the presented approach is effective and promising.

Learning a Push-Recovery Controller for Quadrupedal Robots

Meta-Reinforcement Learning of Hierarchical Fault-Tolerant Controller for Multiple Leg Failures in Hexapod Robots

Push Recovery for the Standing Under-Actuated Bipedal Robot Using the Hip Strategy

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

A Strategy For Push Recovery In Quadruped Robot Based On Reinforcement Learning

Push Recovery Control Based on Model Predictive Control of Hydraulic Quadruped Robots

Robust Recovery Controller for a Quadrupedal Robot using Deep Reinforcement Learning

Learning an Adaptive Fall Recovery Controller for Quadrupeds on Complex Terrains

Learning Push Recovery for A Bipedal Humanoid Robot with Dynamical Movement Primitives

Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning

Hybrid Autonomous Controller for Bipedal Robot Balance with Deep Reinforcement Learning and Pattern Generators

On the Emergence of Whole-body Strategies from Humanoid Robot Push-recovery Learning

Robust Recovery Motion Control for Quadrupedal Robots via Learned Terrain Imagination

Dynamic Fall Recovery Control for Legged Robots via Reinforcement Learning

Model Predictive Control of Quadruped Robot Based on Reinforcement Learning

Anti-push Method of Biped Robot Based on Motion Capture Point and Reinforcement Learning

Learning and Reusing Quadruped Robot Movement Skills from Biological Dogs for Higher-Level Tasks

CPG-Based Hierarchical Locomotion Control for Modular Quadrupedal Robots Using Deep Reinforcement Learning.

Lifelike Agility and Play in Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Models

Learning Agile, Robust Locomotion Skills for Quadruped Robot.

A Hierarchical Framework for Quadruped Robots Gait Planning Based on DDPG