Learning Robust Autonomous Navigation and Locomotion for Wheeled-Legged Robots

Joonho Lee,Marko Bjelonic,Alexander Reske,Lorenz Wellhausen,Takahiro Miki,Marco Hutter

DOI: https://doi.org/10.1126/scirobotics.adi9641

2024-05-03

Abstract:Autonomous wheeled-legged robots have the potential to transform logistics systems, improving operational efficiency and adaptability in urban environments. Navigating urban environments, however, poses unique challenges for robots, necessitating innovative solutions for locomotion and navigation. These challenges include the need for adaptive locomotion across varied terrains and the ability to navigate efficiently around complex dynamic obstacles. This work introduces a fully integrated system comprising adaptive locomotion control, mobility-aware local navigation planning, and large-scale path planning within the city. Using model-free reinforcement learning (RL) techniques and privileged learning, we develop a versatile locomotion controller. This controller achieves efficient and robust locomotion over various rough terrains, facilitated by smooth transitions between walking and driving modes. It is tightly integrated with a learned navigation controller through a hierarchical RL framework, enabling effective navigation through challenging terrain and various obstacles at high speed. Our controllers are integrated into a large-scale urban navigation system and validated by autonomous, kilometer-scale navigation missions conducted in Zurich, Switzerland, and Seville, Spain. These missions demonstrate the system's robustness and adaptability, underscoring the importance of integrated control systems in achieving seamless navigation in complex environments. Our findings support the feasibility of wheeled-legged robots and hierarchical RL for autonomous navigation, with implications for last-mile delivery and beyond.

Robotics,Machine Learning,Systems and Control

What problem does this paper attempt to address?

This paper mainly discusses how to develop an autonomous navigation and mobility system for wheeled-legged robots to address logistics challenges in urban environments. In the study, the authors propose a fully integrated system that includes adaptive motion control, mobility-sensitive local navigation planning, and city-wide path planning. They utilize model-free reinforcement learning (RL) techniques and privilege learning to develop a flexible motion controller that enables efficient and robust movement on various rough terrains and smooth transitions between walking and driving modes.

The paper points out the limitations of traditional wheeled or legged robots in dealing with obstacles and complex terrains in urban environments. Therefore, wheeled-legged robots combine the advantages of both, allowing for high-speed travel over long distances while maintaining agility in difficult terrains. To achieve this goal, the research team tightly integrates the motion controller with the navigation controller through a hierarchical reinforcement learning framework, enabling the robot to traverse complex terrains and various obstacles quickly and effectively.

In practical tests, these controllers were integrated into a large-scale city navigation system and performed kilometer-level autonomous navigation tasks in Zurich, Switzerland, and Seville, Spain, demonstrating the robustness and adaptability of the system. The research results indicate that wheeled-legged robots and hierarchical reinforcement learning have the potential to achieve autonomous navigation, which is crucial for applications such as last-mile delivery.