Abstract:Significant progress has been made in enhancing the motion capabilities of quadruped robots in unstructured environments due to advancements in hardware and control algorithms. However, limited research has been conducted on the fault-tolerant control of quadruped robots, which is crucial for their operation in remote or extreme environments like disaster sites. In this paper, we primarily focus on fault-tolerant strategies for common joint-stuck situations. By leveraging the static stability of quadruped robots, it becomes possible to adjust their control policies and enable them to continue following predetermined trajectories. We introduce a contextual meta-reinforcement learning (Meta-RL) method to design fault-tolerant policies. This method infers task-related latent vectors from the context to assist in training the policy network, ensuring both conciseness and optimality in various situations. Additionally, to expedite algorithm training, we propose a reference action generator (RAG). To validate the proposed algorithm, extensive simulations and physical experiments are conducted. The results demonstrate that our method allows the robot to maintain its trajectory even when faced with motor locking. Furthermore, our method outperforms all baseline algorithms, highlighting its superiority in terms of fault tolerance. Note to Practitioners —The motivation of this article is to provide fault-tolerant policies for quadruped robots, specifically referring to the policies for joint-stuck situations. Previous fault-tolerant strategies either require individually designing control strategies for each joint stuck task, which brings a significant workload to designers, or adopting a unified strategy that cannot provide the optimal strategy for each task. In this article, we utilize the Meta-RL method to handle the joint stuck issue in robots for the first time. By combining the context encoder and RAG, we can provide more suitable policies for various motor-stuck tasks. Both the simulation and physical experiments validate the effectiveness and applicability of this method.

Fault Tolerant Gaits For A Six-Legged Robot With One Locked Or Uncontrollable Failure

Fault-tolerant gait design for quadruped robots with two locked legs using the G F set theory

Fault-tolerant gait design for quadruped robots with one locked leg using the G F set theory

Meta-Reinforcement Learning of Hierarchical Fault-Tolerant Controller for Multiple Leg Failures in Hexapod Robots

A fault tolerant gait for a hexapod robot over uneven terrain

Meta Reinforcement Learning of Locomotion Policy for Quadruped Robots with Motor Stuck

Fault-tolerant motion planning and generation of quadruped robots synthesised by posture optimization and whole body control

Free Gait Transition and Stable Motion Generation Using CPG-based Locomotion Control for Hexapod Robots

A Residual Meta-Reinforcement Learning Method for Training Fault-Tolerant Policies for Quadruped Robots

High efficient walking of compass-like biped robots with foot rotation

Fault-tolerant motion planning for a hexapod robot with single-leg failure using a foot force control method

Multi-Task Learning of Active Fault-Tolerant Controller for Leg Failures in Quadruped robots

Adaptive Walking Pattern Generation with Damaged Legs for the six-legged Robot LAURON V

Saving the Limping: Fault-tolerant Quadruped Locomotion via Reinforcement Learning

Towards Hybrid Gait Obstacle Avoidance for a Six Wheel-Legged Robot with Payload Transportation

Novel method of gait switching in six-legged robot walking on continuous-nondifferentiable terrain by utilizing stability and interference criteria

Flexible gait transition for six wheel-legged robot with unstructured terrains

Technical Report on: Tripedal Dynamic Gaits for a Quadruped Robot

High-Flexibility Locomotion and Whole-Torso Control for a Wheel-Legged Robot on Challenging Terrain.

Flexible Motion Framework of the Six Wheel-legged Robot: Experimental Results

Design and Control of a Multi-Locomotion Parallel-Legged Bipedal Robot