Abstract:Significant progress has been made in enhancing the motion capabilities of quadruped robots in unstructured environments due to advancements in hardware and control algorithms. However, limited research has been conducted on the fault-tolerant control of quadruped robots, which is crucial for their operation in remote or extreme environments like disaster sites. In this paper, we primarily focus on fault-tolerant strategies for common joint-stuck situations. By leveraging the static stability of quadruped robots, it becomes possible to adjust their control policies and enable them to continue following predetermined trajectories. We introduce a contextual meta-reinforcement learning (Meta-RL) method to design fault-tolerant policies. This method infers task-related latent vectors from the context to assist in training the policy network, ensuring both conciseness and optimality in various situations. Additionally, to expedite algorithm training, we propose a reference action generator (RAG). To validate the proposed algorithm, extensive simulations and physical experiments are conducted. The results demonstrate that our method allows the robot to maintain its trajectory even when faced with motor locking. Furthermore, our method outperforms all baseline algorithms, highlighting its superiority in terms of fault tolerance. Note to Practitioners —The motivation of this article is to provide fault-tolerant policies for quadruped robots, specifically referring to the policies for joint-stuck situations. Previous fault-tolerant strategies either require individually designing control strategies for each joint stuck task, which brings a significant workload to designers, or adopting a unified strategy that cannot provide the optimal strategy for each task. In this article, we utilize the Meta-RL method to handle the joint stuck issue in robots for the first time. By combining the context encoder and RAG, we can provide more suitable policies for various motor-stuck tasks. Both the simulation and physical experiments validate the effectiveness and applicability of this method.

A Residual Meta-Reinforcement Learning Method for Training Fault-Tolerant Policies for Quadruped Robots

Meta Reinforcement Learning of Locomotion Policy for Quadruped Robots with Motor Stuck

Meta-Reinforcement Learning of Hierarchical Fault-Tolerant Controller for Multiple Leg Failures in Hexapod Robots

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Saving the Limping: Fault-tolerant Quadruped Locomotion via Reinforcement Learning

Multi-Task Learning of Active Fault-Tolerant Controller for Leg Failures in Quadruped robots

Reinforcement Learning based Control of a Quadruped Robot

A Hierarchical Reinforcement Learning Approach to Control Legged Mobile Manipulators

Fault-tolerant motion planning and generation of quadruped robots synthesised by posture optimization and whole body control

Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning

Zero-Shot Retargeting of Learned Quadruped Locomotion Policies Using Hybrid Kinodynamic Model Predictive Control

An advanced reinforcement learning control method for quadruped robots in typical urban terrains

Kinematic Analysis and Motion Planning of A Quadruped Robot with Partially Faulty Actuators

Reinforcement Learning-based Fault-Tolerant Control of Robot Arms.

Continual Reinforcement Learning for Quadruped Robot Locomotion

A Motion Planning and Control Method of Quadruped Robot Based on Deep Reinforcement Learning

Imitating and Finetuning Model Predictive Control for Robust and Symmetric Quadrupedal Locomotion

MetaLoco: Universal Quadrupedal Locomotion with Meta-Reinforcement Learning and Motion Imitation

Dynamic Fall Recovery Control for Legged Robots via Reinforcement Learning

Active Fault-Tolerant Control Integrated with Reinforcement Learning Application to Robotic Manipulator

Control of Parallel Quadruped Robots Based on Adaptive Dynamic Programming Control