Abstract:Quadrupedal robots are highly regarded for their superior locomotion capabilities and terrain adaptability, making them competent in a wide range of applications. In autonomous navigation tasks, they are required to track upper-level trajectories to reach designated locations with flexible obstacle avoidance. This is typically achieved by a planner which generates a reference velocity and a controller which accurately tracks the velocity commands. In this article, we propose a learning-based controller for quadrupedal robots that achieves accurate and robust velocity tracking. To bridge the gap between simulation and reality, an analytical actuator model is proposed to simulate physical actuator dynamics. We then train a control policy in simulation using Constrained Reinforcement Learning, where symmetry and smoothness constraints are incorporated into reinforcement learning. The symmetry constraint promotes coordinated locomotion and consistent velocity tracking performance, while the smoothness constraint reduces jerky actions and generates stable velocity performance. The control policy is zero-shot deployed on the Unitree AlienGo. It demonstrates a tracking error of less than 0.084 m/s over the entire velocity range and robust locomotion on natural terrain. We also test our controller by integrating it to a pedestrian tracking framework and prove its capability of trajectory following and long-term reliablitiy.

Modeling And Fuzzy Q-Learning Control Of Biped Walking

Learning biped locomotion based on Q-learning and neural networks

A Zmp and Com Online Replanning Method for Stable Walking of Bipedal Robots

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Stable walking control and strategy of under-actuated biped robot

Obstacle avoidance strategy for biped robot based on fuzzy q-learning

Energy efficient walking control for biped robots using interval type-2 fuzzy logic systems and optimized iteration algorithm.

Online Control for Biped Robot with Incremental Learning Mechanism

Bipedal walking pattern generation and control for humanoid robot with bivariate stability margin optimization

Biped trajectory generation method based on fuzzy logic

Dynamically Stable 3D Quadrupedal Walking with Multi-Domain Hybrid System Models and Virtual Constraint Controllers

Human-In-The-Loop Control System Based on the Biped Walking-Chair Robot

Fuzzy Logic Based Body State Estimation In A Bipedal Robot With Passive Dynamic Gaits

Design and Dynamic Locomotion Control of Quadruped Robot with Perception-Less Terrain Adaptation

Human-in-the-loop control system based on the biped waIking - Chair robot

Design Of Quadruped Robot Based Cpg And Fuzzy Neural Network

Robust Controller Design for a Quadruped Walking Robot

A Simplified Control Method to Achieve Stable and Robust Quadrupedal Quasi-Passive Walking with Compliant Legs

Biped Walking Based on Stiffness Optimization and Hierarchical Quadratic Programming

Universal Walking Control Framework of Biped Robot Based on Dynamic Model and Quadratic Programming

Realization of the Biologically-Inspired Dynamic Walking Controller of a Quadruped Robot