Abstract:Quadrupedal robots are highly regarded for their superior locomotion capabilities and terrain adaptability, making them competent in a wide range of applications. In autonomous navigation tasks, they are required to track upper-level trajectories to reach designated locations with flexible obstacle avoidance. This is typically achieved by a planner which generates a reference velocity and a controller which accurately tracks the velocity commands. In this article, we propose a learning-based controller for quadrupedal robots that achieves accurate and robust velocity tracking. To bridge the gap between simulation and reality, an analytical actuator model is proposed to simulate physical actuator dynamics. We then train a control policy in simulation using Constrained Reinforcement Learning, where symmetry and smoothness constraints are incorporated into reinforcement learning. The symmetry constraint promotes coordinated locomotion and consistent velocity tracking performance, while the smoothness constraint reduces jerky actions and generates stable velocity performance. The control policy is zero-shot deployed on the Unitree AlienGo. It demonstrates a tracking error of less than 0.084 m/s over the entire velocity range and robust locomotion on natural terrain. We also test our controller by integrating it to a pedestrian tracking framework and prove its capability of trajectory following and long-term reliablitiy.

Robust Control of Quadruped Robots Using Reinforcement Learning and Depth Completion Network

Real-time Localization, Mapping and Navigation for Quadruped Robots

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Environmental Features Assessment Network Aided Deep Reinforcement Learning for Quadrupedal Locomotion in Tough Terrain

Sim-to-real: Quadruped Robot Control with Deep Reinforcement Learning and Parallel Training

An advanced reinforcement learning control method for quadruped robots in typical urban terrains

Reinforcement Learning based Control of a Quadruped Robot

Robust Motion Control for UAV in Dynamic Uncertain Environments Using Deep Reinforcement Learning.

Quadruped robot traversing 3D complex environments with limited perception

Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning

Agile Control for Quadruped Robot in Complex Environment Based on Deep Reinforcement Learning Method.

A Motion Planning and Control Method of Quadruped Robot Based on Deep Reinforcement Learning

Whole-body Motion Planning and Control of a Quadruped Robot for Challenging Terrain.

Learning Quadrupedal Locomotion on Tough Terrain Using an Asymmetric Terrain Feature Mining Network

ZSL-RPPO: Zero-Shot Learning for Quadrupedal Locomotion in Challenging Terrains using Recurrent Proximal Policy Optimization

Animal-Like Eye Vision Assisted Locomotion of a Quadruped Based on Reinforcement Learning.

Single Leg Operational Space Control of Quadruped Robot Based on Reinforcement Learning

Learning Fast and Agile Quadrupedal Locomotion over Complex Terrain

Vision-Assisted Localization and Terrain Reconstruction with Quadruped Robots

Real-time Replanning and Control of Quadruped Robots for Blind Locomotion on Uneven Terrain

Learning Smooth and Omnidirectional Locomotion for Quadruped Robots