Abstract:In the field of quadruped robots, the most classic motion control algorithm is based on model prediction control (MPC). However, this method poses challenges as it necessitates the precise construction of the robot's dynamics model, making it difficult to achieve agile movements similar to those of a biological dog. Due to these limitations, researchers are increasingly turning to model-free learning methods, which significantly reduce the difficulty of modeling and engineering debugging and simultaneously reduce real-time optimization computational burden. Inspired by the growth process of humans and animals, from learning to walk to fluent movements, this article proposes a hierarchical reinforcement learning framework for the motion controller to learn some higher-level tasks. First, some basic motion skills can be learned from motion data captured from a biological dog. Then, with these learned basic motion skills as a foundation, the quadruped robot can focus on learning higher-level tasks without starting from low-level kinematics, which saves redundant training time. By utilizing domain randomization techniques during the training process, the trained policy function can be directly transferred to a physical robot without modification, and the resulting controller can perform more biomimetic movements. By implementing the method proposed in this article, the agility and adaptability of the quadruped robot can be maximally utilized to achieve efficient operations in complex terrains.

An Efficient Closed-loop Adaptive Controller for a Small-sized Quadruped Robotic Rat

Posture Estimation and Trajectory Tracking for SQuRo: a Small-sized Quadruped Robotic Rat

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Development of a Small-Sized Quadruped Robotic Rat Capable of Multimodal Motions

Nonlinear MPC-Based Control Framework for Quadruped Robots: Touch-Down in Complex Terrain

Efficient Motion Planning Based on Kinodynamic Model for Quadruped Robots Following Persons in Confined Spaces

Design and Control of a Miniature Quadruped Rat-inspired Robot

Crawling Gait Enables Stable Quadrupedal Locomotion in A Bioinspired Robotic Rat

Real-time Replanning and Control of Quadruped Robots for Blind Locomotion on Uneven Terrain

Whole-body Motion Planning and Control of a Quadruped Robot for Challenging Terrain.

Bioinspired Soft Spine Enables Small-Scale Robotic Rat to Conquer Challenging Environments

Adaptive Locomotion Controller for a Quadruped Robot on a High-Slope Terrain

Biologically-Inspired Adaptive Movement Control For A Quadrupedal Robot

Adaptive Walking of a Quadrupedal Robot Based on Layered Biological Reflexes

Learning and Reusing Quadruped Robot Movement Skills from Biological Dogs for Higher-Level Tasks

MorAL: Learning Morphologically Adaptive Locomotion Controller for Quadrupedal Robots on Challenging Terrains

Learning Agile, Robust Locomotion Skills for Quadruped Robot.

Quadruped robot traversing 3D complex environments with limited perception

A Novel Control Strategy for Quadruped Robot Walking over Irregular Terrain

Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning

Behavior-Based Control Of A Hybrid Quadruped Robot