Abstract:The enhanced mobility brought by legged locomotion empowers quadrupedal robots to navigate through complex and unstructured environments. However, optimizing agile locomotion while accounting for the varying energy costs of traversing different terrains remains an open challenge. Most previous work focuses on planning trajectories with traversability cost estimation based on human-labeled environmental features. However, this human-centric approach is insufficient because it does not account for the varying capabilities of the robot locomotion controllers over challenging terrains. To address this, we develop a novel traversability estimator in a robot-centric manner, based on the value function of the robot's locomotion controller. This estimator is integrated into a new learning-based RGBD navigation framework. The framework develops a planner that guides the robot in avoiding obstacles and hard-to-traverse terrains while reaching its goals. The training of the navigation planner is directly performed in the real world using a sample efficient reinforcement learning method. Through extensive benchmarking, we demonstrate that the proposed framework achieves the best performance in accurate traversability cost estimation and efficient learning from multi-modal data (the robot's color and depth vision, and proprioceptive feedback) for real-world training. Using the proposed method, a quadrupedal robot learns to perform traversability-aware navigation through trial and error in various real-world environments with challenging terrains that are difficult to classify using depth vision alone.

A real-time low-computation cost human-following framework in outdoor environment for legged robots

Efficient Motion Planning Based on Kinodynamic Model for Quadruped Robots Following Persons in Confined Spaces

An Efficient and Robust System for Human Following Scenario Using Differential Robot

People Following System Based on LRF

Human Tracking and Following in Dynamic Environment for Service Robots

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Real-time Localization, Mapping and Navigation for Quadruped Robots

A Zmp and Com Online Replanning Method for Stable Walking of Bipedal Robots

An Autonomous Robot for Collision-Free Person Following Through Model Predictive Control

A Skeleton and Visual Tracking Fusion Based Person-Following System for Mobile Service Robots

Human Following for Wheeled Robot with Monocular Pan-tilt Camera

A quadruped robot obstacle avoidance and personnel following strategy based on ultra-wideband and three-dimensional laser radar

Real-Time Navigation In Dynamic Human Environments Using Optimal Reciprocal Collision Avoidance

Obstacle-Avoidant Leader Following with a Quadruped Robot

Close-range Human Following Control on a Cane-type Robot with Multi-camera Fusion

Human Tracking and Following of Mobile Robot with a Laser Scanner

Advanced Multi-Sensor Person-Following System on a Mobile Robot: Design, Construction and Measurements

Traversability-Aware Legged Navigation by Learning from Real-World Visual Data

A Real-Time Planning and Control Framework for Robust and Dynamic Quadrupedal Locomotion

Laser-Based Side-by-Side Following for Human-Following Robots