Abstract:Reinforcement learning method is extremely competitive in gait generation techniques for quadrupedal robot, which is mainly due to the fact that stochastic exploration in reinforcement training is beneficial to achieve an autonomous gait. Nevertheless, although incremental reinforcement learning is employed to improve training success and movement smoothness by relying on the continuity inherent during limb movements, challenges remain in adapting gait policy to diverse terrain and external disturbance. Inspired by the association between reinforcement learning and the evolution of animal motion behavior, a self-improvement mechanism for reference gait is introduced in this paper to enable incremental learning of action and self-improvement of reference action together to imitate the evolution of animal motion behavior. Further, a new framework for reinforcement training of quadruped gait is proposed. In this framework, genetic algorithm is specifically adopted to perform global probabilistic search for the initial value of the arbitrary foot trajectory to update the reference trajectory with better fitness. Subsequently, the improved reference gait is used for incremental reinforcement learning of gait. The above process is repeatedly and alternatively executed to finally train the gait policy. The analysis considering terrain, model dimensions, and locomotion condition is presented in detail based on simulation, and the results show that the framework is significantly more adaptive to terrain compared to regular incremental reinforcement learning.

Quadrupedal Locomotion in an Energy-efficient Way Based on Reinforcement Learning

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Economical Quadrupedal Multi-Gait Locomotion via Gait-Heuristic Reinforcement Learning

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Efficient Motion Planning Based on Kinodynamic Model for Quadruped Robots Following Persons in Confined Spaces

A Hierarchical Framework for Quadruped Robots Gait Planning Based on DDPG

Fast and Efficient Locomotion via Learned Gait Transitions

Reinforcement Learning based Control of a Quadruped Robot

Energy Consumption Minimization of Quadruped Robot Based on Reinforcement Learning of DDPG Algorithm

CPG-Based Hierarchical Locomotion Control for Modular Quadrupedal Robots Using Deep Reinforcement Learning.

Adaptive Energy Regularization for Autonomous Gait Transition and Energy-Efficient Quadruped Locomotion

Learning and Reusing Quadruped Robot Movement Skills from Biological Dogs for Higher-Level Tasks

A Motion Planning and Control Method of Quadruped Robot Based on Deep Reinforcement Learning

An Energy Efficient Motion Controller Based on SLCP for the Electrically Actuated Quadruped Robot

High Dynamic Position Control for a Typical Hydraulic Quadruped Robot Leg Based on Virtual Decomposition Control

A Real-Time Planning and Control Framework for Robust and Dynamic Quadrupedal Locomotion

Locomotion Control for Quadruped Robot Combining Central Pattern Generators with Virtual Model Control

Behavior evolution-inspired approach to walking gait reinforcement training for quadruped robots

Hybrid Bipedal Locomotion Based on Reinforcement Learning and Heuristics

Synthesizing the optimal gait of a quadruped robot with soft actuators using deep reinforcement learning

Energetic Analysis on the Optimal Bounding Gaits of Quadrupedal Robots