All-in-One: A DRL-based Control Switch Combining State-of-the-art Navigation Planners

Linh Kästner,Johannes Cox,Teham Buiyan,Jens Lambrecht

DOI: https://doi.org/10.48550/arXiv.2109.11636

2021-09-24

Abstract:Autonomous navigation of mobile robots is an essential aspect in use cases such as delivery, assistance or logistics. Although traditional planning methods are well integrated into existing navigation systems, they struggle in highly dynamic environments. On the other hand, Deep-Reinforcement-Learning-based methods show superior performance in dynamic obstacle avoidance but are not suitable for long-range navigation and struggle with local minima. In this paper, we propose a Deep-Reinforcement-Learning-based control switch, which has the ability to select between different planning paradigms based solely on sensor data observations. Therefore, we develop an interface to efficiently operate multiple model-based, as well as learning-based local planners and integrate a variety of state-of-the-art planners to be selected by the control switch. Subsequently, we evaluate our approach against each planner individually and found improvements in navigation performance especially for highly dynamic scenarios. Our planner was able to prefer learning-based approaches in situations with a high number of obstacles while relying on the traditional model-based planners in long corridors or empty spaces.

Robotics

What problem does this paper attempt to address?

This paper aims to solve the problem of autonomous navigation of mobile robots in highly dynamic environments. Specifically, although traditional planning methods have been well integrated into existing navigation systems, they perform poorly in highly dynamic environments. On the other hand, methods based on deep reinforcement learning (DRL) perform excellently in dynamic obstacle avoidance, but are not suitable for long - distance navigation and are prone to getting stuck in the local minimum problem. Therefore, the paper proposes a DRL - based control switching mechanism, which can select different planning paradigms according to sensor data observations, thereby combining the advantages of model - driven and learning - driven local planners to improve navigation performance, especially in highly dynamic scenarios. The main contributions of the paper include: 1. Integrating model - driven and learning - driven local planners into a hierarchical navigation system. 2. Proposing a DRL - based control switching mechanism that can select among multiple local planners based on 2D laser scan observations. 3. Conducting extensive evaluations of the proposed control switching mechanism and comparing it with the benchmark navigation system in terms of safety, efficiency and robustness. In this way, this paper attempts to provide a more flexible, safe and efficient navigation solution, especially suitable for highly dynamic environments where fast - moving obstacles need to be dealt with.

All-in-One: A DRL-based Control Switch Combining State-of-the-art Navigation Planners

A LiDAR Based End to End Controller for Robot Navigation Using Deep Neural Network

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

An Efficient Deep Reinforcement Learning Algorithm for Mapless Navigation with Gap-Guided Switching Strategy

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Learning whom to trust in navigation: dynamically switching between classical and neural planning

iNAV-drlSLAM: An Improved Indoor Self-Driving Framework for Mobile Robots using Deep Reinforcement Learning integrated with SLAM

Learning to Navigate in Indoor Environments: from Memorizing to Reasoning

When to Replan? An Adaptive Replanning Strategy for Autonomous Navigation using Deep Reinforcement Learning

Deep Local Trajectory Replanning and Control for Robot Navigation

HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks

End-to-end Autonomous Vehicle Navigation Control Method Guided by the Dynamic Window Approach

Holistic Deep-Reinforcement-Learning-based Training of Autonomous Navigation Systems

Motion Planner with Fixed-Horizon Constrained Reinforcement Learning for Complex Autonomous Driving Scenarios

Connecting Deep-Reinforcement-Learning-based Obstacle Avoidance with Conventional Global Planners using Waypoint Generators

A Comparison Study between Traditional and Deep-Reinforcement-Learning-Based Algorithms for Indoor Autonomous Navigation in Dynamic Scenarios

Deep reinforcement learning-aided autonomous navigation with landmark generators

Deep reinforcement learning oriented for real world dynamic scenarios

Influence of Sensor Noise and Latency on Navigational Safety of Deep-Reinforcement-Learning-based Planners

Navigation System with SLAM-based Trajectory Topological Map and Reinforcement Learning-Based Local Planner