Abstract:Stable gait generation is a crucial problem for legged robot locomotion as this impacts other critical performance factors such as, e.g. mobility over an uneven terrain and power consumption. Gait generation stability results from the efficient control of the interaction between the legged robot's body and the environment where it moves. Here, we study how this can be achieved by a combination of model-predictive and predictive reinforcement learning controllers. Model-predictive control (MPC) is a well-established method that does not utilize any online learning (except for some adaptive variations) as it provides a convenient interface for state constraints management. Reinforcement learning (RL), in contrast, relies on adaptation based on pure experience. In its bare-bone variants, RL is not always suitable for robots due to their high complexity and expensive simulation/experimentation. In this work, we combine both control methods to address the quadrupedal robot stable gate generation problem. The hybrid approach that we develop and apply uses a cost roll-out algorithm with a tail cost in the form of a Q-function modeled by a neural network; this allows to alleviate the computational complexity, which grows exponentially with the prediction horizon in a purely MPC approach. We demonstrate that our RL gait controller achieves stable locomotion at short horizons, where a nominal MP controller fails. Further, our controller is capable of live operation, meaning that it does not require previous training. Our results suggest that the hybridization of MPC with RL, as presented here, is beneficial to achieve a good balance between online control capabilities and computational complexity.

Gait Stability Control of Quadruped Robot by Composite Nonlinear Feedback and Model Predictive Control

Nonlinear MPC-Based Control Framework for Quadruped Robots: Touch-Down in Complex Terrain

A composite motion control method for quadruped robots in trot gait

Research on composite anti-disturbance adaptive constraint control strategy for quadruped robot

Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotion

Model Predictive Control for Motion Planning of Quadrupedal Locomotion.

Contingency Model Predictive Control for Bipedal Locomotion on Moving Surfaces with a Linear Inverted Pendulum Model

High Dynamic Position Control for a Typical Hydraulic Quadruped Robot Leg Based on Virtual Decomposition Control

Nonlinear model predictive control for robust bipedal locomotion: exploring angular momentum and CoM height changes

An improved stable motion control method for quadruped robot based on CPG and VMC

Legged Robot Locomotion Via Hybrid Zero Dynamics and Model Predictive Control

Adaptive Model Predictive Control with Data-driven Error Model for Quadrupedal Locomotion

Real-Time Control of Full Actuated Biped Robot Based on Nonlinear Model Predictive Control

Universal Walking Control Framework of Biped Robot Based on Dynamic Model and Quadratic Programming

CPG-Based Control Scheme for Quadruped Robot to Withstand the Lateral Impact

Multi-constraint spatial coupling for the body joint quadruped robot and the CPG control method on rough terrain

Terrain Adaptive Gait Transitioning for a Quadruped Robot using Model Predictive Control

Dynamically Stable 3D Quadrupedal Walking with Multi-Domain Hybrid System Models and Virtual Constraint Controllers

A Multi-module Controller for Walking Quadruped Robots

Bounding gait control of a parallel quadruped robot

Reduced Model Predictive Control Toward Highly Dynamic Quadruped Locomotion