Abstract:Significant progress has been made in enhancing the motion capabilities of quadruped robots in unstructured environments due to advancements in hardware and control algorithms. However, limited research has been conducted on the fault-tolerant control of quadruped robots, which is crucial for their operation in remote or extreme environments like disaster sites. In this paper, we primarily focus on fault-tolerant strategies for common joint-stuck situations. By leveraging the static stability of quadruped robots, it becomes possible to adjust their control policies and enable them to continue following predetermined trajectories. We introduce a contextual meta-reinforcement learning (Meta-RL) method to design fault-tolerant policies. This method infers task-related latent vectors from the context to assist in training the policy network, ensuring both conciseness and optimality in various situations. Additionally, to expedite algorithm training, we propose a reference action generator (RAG). To validate the proposed algorithm, extensive simulations and physical experiments are conducted. The results demonstrate that our method allows the robot to maintain its trajectory even when faced with motor locking. Furthermore, our method outperforms all baseline algorithms, highlighting its superiority in terms of fault tolerance. Note to Practitioners —The motivation of this article is to provide fault-tolerant policies for quadruped robots, specifically referring to the policies for joint-stuck situations. Previous fault-tolerant strategies either require individually designing control strategies for each joint stuck task, which brings a significant workload to designers, or adopting a unified strategy that cannot provide the optimal strategy for each task. In this article, we utilize the Meta-RL method to handle the joint stuck issue in robots for the first time. By combining the context encoder and RAG, we can provide more suitable policies for various motor-stuck tasks. Both the simulation and physical experiments validate the effectiveness and applicability of this method.

A Strategy For Push Recovery In Quadruped Robot Based On Reinforcement Learning

Push Recovery for the Standing Under-Actuated Bipedal Robot Using the Hip Strategy

Push Recovery for Humanoid Robots with Passive Damped Ankles

Push Recovery Control Based on Model Predictive Control of Hydraulic Quadruped Robots

Meta Reinforcement Learning of Locomotion Policy for Quadruped Robots with Motor Stuck

Learning Push Recovery for A Bipedal Humanoid Robot with Dynamical Movement Primitives

Active Control Of Under-Actuated Foot Tilting For Humanoid Push Recovery

Learning a Push-Recovery Controller for Quadrupedal Robots

A Residual Meta-Reinforcement Learning Method for Training Fault-Tolerant Policies for Quadruped Robots

Push Recovery of a Humanoid Robot Based on Model Predictive Control and Capture Point

Push recovery with stepping strategy based on time-projection control

Anti-push Method of Biped Robot Based on Motion Capture Point and Reinforcement Learning

On the Emergence of Whole-body Strategies from Humanoid Robot Push-recovery Learning

Reinforcement Learning based Control of a Quadruped Robot

Foot Placement Estimator for Quadruped Push Recovery

Push Recovery of a Position-Controlled Humanoid Robot Based on Capture Point Feedback Control

Reactive Stepping for Humanoid Robots using Reinforcement Learning: Application to Standing Push Recovery on the Exoskeleton Atalante

Balance Recovery Analysis With Constraints Of Feet-Ground For Biped Robot

Robust Recovery Motion Control for Quadrupedal Robots via Learned Terrain Imagination

Enhancing Model-Based Step Adaptation for Push Recovery through Reinforcement Learning of Step Timing and Region

Push Recovery by Stepping with Step Timing Adjustment