Abstract:The enhanced mobility brought by legged locomotion empowers quadrupedal robots to navigate through complex and unstructured environments. However, optimizing agile locomotion while accounting for the varying energy costs of traversing different terrains remains an open challenge. Most previous work focuses on planning trajectories with traversability cost estimation based on human-labeled environmental features. However, this human-centric approach is insufficient because it does not account for the varying capabilities of the robot locomotion controllers over challenging terrains. To address this, we develop a novel traversability estimator in a robot-centric manner, based on the value function of the robot's locomotion controller. This estimator is integrated into a new learning-based RGBD navigation framework. The framework develops a planner that guides the robot in avoiding obstacles and hard-to-traverse terrains while reaching its goals. The training of the navigation planner is directly performed in the real world using a sample efficient reinforcement learning method. Through extensive benchmarking, we demonstrate that the proposed framework achieves the best performance in accurate traversability cost estimation and efficient learning from multi-modal data (the robot's color and depth vision, and proprioceptive feedback) for real-world training. Using the proposed method, a quadrupedal robot learns to perform traversability-aware navigation through trial and error in various real-world environments with challenging terrains that are difficult to classify using depth vision alone.

Real-time Obstacle Detection for Legged Robots Using the Kinect Sensor

Real-Time Path Planning for Mobile Robots

Monocular Vision Based Obstacle Detection for Robot Navigation in Unstructured Environment

Real-time Localization, Mapping and Navigation for Quadruped Robots

Efficient Motion Planning Based on Kinodynamic Model for Quadruped Robots Following Persons in Confined Spaces

Obstacle Avoidance for a Hexapod Robot in Unknown Environment

Real-Time Navigation In Dynamic Human Environments Using Optimal Reciprocal Collision Avoidance

Obstacle Avoidance and Terrain Identification for a Hexapod Robot

Real Time Obstacle Detection System for Biped Robot

A Real-Time Multi-Constraints Obstacle Avoidance Method Using LiDAR

Real-Time Avoidance Strategy of Dynamic Obstacles via Half Model-Free Detection and Tracking With 2D Lidar for Mobile Robots

Vision-Guided Six-Legged Walking of Little Crabster Using a Kinect Sensor

Real-Time Navigation for Bipedal Robots in Dynamic Environments

A real-time low-computation cost human-following framework in outdoor environment for legged robots

Obstacle Overcoming Gait Design for Quadruped Robot with Vision and Tactile Sensing Feedback

Scene understanding for a high-mobility walking robot

Real-Time Hybrid Navigation System-Based Path Planning and Obstacle Avoidance for Mobile Robots

Real-Time Safe Bipedal Robot Navigation using Linear Discrete Control Barrier Functions

Target tracking and obstacle avoidance of mobile robot using Kinect

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Traversability-Aware Legged Navigation by Learning from Real-World Visual Data