Abstract:Reinforcement learning method is extremely competitive in gait generation techniques for quadrupedal robot, which is mainly due to the fact that stochastic exploration in reinforcement training is beneficial to achieve an autonomous gait. Nevertheless, although incremental reinforcement learning is employed to improve training success and movement smoothness by relying on the continuity inherent during limb movements, challenges remain in adapting gait policy to diverse terrain and external disturbance. Inspired by the association between reinforcement learning and the evolution of animal motion behavior, a self-improvement mechanism for reference gait is introduced in this paper to enable incremental learning of action and self-improvement of reference action together to imitate the evolution of animal motion behavior. Further, a new framework for reinforcement training of quadruped gait is proposed. In this framework, genetic algorithm is specifically adopted to perform global probabilistic search for the initial value of the arbitrary foot trajectory to update the reference trajectory with better fitness. Subsequently, the improved reference gait is used for incremental reinforcement learning of gait. The above process is repeatedly and alternatively executed to finally train the gait policy. The analysis considering terrain, model dimensions, and locomotion condition is presented in detail based on simulation, and the results show that the framework is significantly more adaptive to terrain compared to regular incremental reinforcement learning.

MCLER: Multi-Critic Continual Learning with Experience Replay for Quadruped Gait Generation

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Economical Quadrupedal Multi-Gait Locomotion via Gait-Heuristic Reinforcement Learning

CLFR-M: Continual Learning Framework for Robots Via Human Feedback and Dynamic Memory

Multi-Layered CPG for Adaptive Walking of Quadruped Robots

Behavior evolution-inspired approach to walking gait reinforcement training for quadruped robots

Skill Latent Space Based Multigait Learning for a Legged Robot

Experience-Learning Inspired Two-Step Reward Method for Efficient Legged Locomotion Learning Towards Natural and Robust Gaits

Quadruped Robot Get Bionic Learning Method Based on Intelligent Memory Soft Actor-Critic

MorAL: Learning Morphologically Adaptive Locomotion Controller for Quadrupedal Robots on Challenging Terrains

Learning Multiple Gaits within Latent Space for Quadruped Robots

M-A3C: A Mean-Asynchronous Advantage Actor-Critic Reinforcement Learning Method for Real-Time Gait Planning of Biped Robot.

Continual Reinforcement Learning for Quadruped Robot Locomotion

A Motion Planning and Control Method of Quadruped Robot Based on Deep Reinforcement Learning

Quadruped Robot Locomotion in Unknown Terrain Using Deep Reinforcement Learning

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

Terrain-Aware Quadrupedal Locomotion via Reinforcement Learning

CPG-Based Hierarchical Locomotion Control for Modular Quadrupedal Robots Using Deep Reinforcement Learning.

MetaLoco: Universal Quadrupedal Locomotion with Meta-Reinforcement Learning and Motion Imitation

Lifelike Agility and Play in Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Models

SYNLOCO: Synthesizing Central Pattern Generator and Reinforcement Learning for Quadruped Locomotion