Learning Terrain-Adaptive Locomotion with Agile Behaviors by Imitating Animals

Tingguang Li,Yizheng Zhang,Chong Zhang,Qingxu Zhu,Jiapeng sheng,Wanchao Chi,Cheng Zhou,Lei Han

2023-08-07

Abstract:In this paper, we present a general learning framework for controlling a quadruped robot that can mimic the behavior of real animals and traverse challenging terrains. Our method consists of two steps: an imitation learning step to learn from motions of real animals, and a terrain adaptation step to enable generalization to unseen terrains. We capture motions from a Labrador on various terrains to facilitate terrain adaptive locomotion. Our experiments demonstrate that our policy can traverse various terrains and produce a natural-looking behavior. We deployed our method on the real quadruped robot Max via zero-shot simulation-to-reality transfer, achieving a speed of 1.1 m/s on stairs climbing.

Robotics

What problem does this paper attempt to address?

The problem this paper attempts to address is how to enable quadruped robots to mimic the behavior of real animals and perform adaptive movements on complex terrains. Specifically, the researchers propose a general learning framework that allows quadruped robots to traverse challenging terrains by imitating the movements of real animals. The main contributions of the paper include: 1. **Constructing a motion capture dataset containing motion data on different terrains**: This is the first dataset to include terrain-aware motion data, collected from a Labrador Retriever on various terrains such as slopes and stairs. 2. **Proposing a two-step learning process**: First, the robot learns to track reference motions in a simulated environment through an Imitation Learning step, and then the policy is generalized to unseen terrains through a Terrain Adaptation step. 3. **Successfully deploying the controller to a real quadruped robot**: Achieving zero-shot transfer from simulation to the real world, demonstrating natural behavior on various terrains, and achieving a speed of 1.1 meters/second in stair-climbing tasks. Through these contributions, the researchers aim to improve the adaptability and natural behavior performance of quadruped robots in complex, uneven, and unstructured environments.

Learning Terrain-Adaptive Locomotion with Agile Behaviors by Imitating Animals

Learning Gait-conditioned Bipedal Locomotion with Motor Adaptation

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Terrain-Aware Quadrupedal Locomotion via Reinforcement Learning

Learning Robust, Agile, Natural Legged Locomotion Skills in the Wild

Lifelike Agility and Play in Quadrupedal Robots using Reinforcement Learning and Generative Pre-trained Models

Learning Agile Locomotion on Risky Terrains

Learning Bipedal Walking on a Quadruped Robot via Adversarial Motion Priors

Learning Quadrupedal Locomotion on Tough Terrain Using an Asymmetric Terrain Feature Mining Network

Learning Highly Dynamic Behaviors for Quadrupedal Robots

Learning Generic and Dynamic Locomotion of Humanoids Across Discrete Terrains

Learning Agile, Robust Locomotion Skills for Quadruped Robot.

A Novel Framework for Adaptive Quadruped Robot Locomotion Learning in Uncertain Environments.

Learning Agile Bipedal Motions on a Quadrupedal Robot

Learning and Reusing Quadruped Robot Movement Skills from Biological Dogs for Higher-Level Tasks

Experience-Learning Inspired Two-Step Reward Method for Efficient Legged Locomotion Learning Towards Natural and Robust Gaits

Learning and Adapting Agile Locomotion Skills by Transferring Experience

Design and Dynamic Locomotion Control of Quadruped Robot with Perception-Less Terrain Adaptation

Generalized Animal Imitator: Agile Locomotion with Versatile Motion Prior

Walking with Terrain Reconstruction: Learning to Traverse Risky Sparse Footholds

Learning an Adaptive Fall Recovery Controller for Quadrupeds on Complex Terrains