Abstract:This paper introduces novel deep reinforcement learning (Deep-RL) techniques using parallel distributional actor-critic networks for navigating terrestrial mobile robots. Our approaches use laser range findings, relative distance, and angle to the target to guide the robot. We trained agents in the Gazebo simulator and deployed them in real scenarios. Results show that parallel distributional Deep-RL algorithms enhance decision-making and outperform non-distributional and behavior-based approaches in navigation and spatial generalization.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve map - free navigation of ground - moving robots in complex environments. Specifically, the researchers proposed a new deep reinforcement learning (Deep - RL) technique, using parallel - distributed actor - critic networks to guide robot navigation. These methods utilize laser ranging data, the relative distance and angle of the target to guide the robot, and train agents in the Gazebo simulator, and then deploy them in real - world scenarios. The main contributions of the paper include: 1. Proposing two new distributed deep reinforcement learning methods, namely parallel - distributed deterministic reinforcement learning (PDDRL) and parallel - distributed stochastic reinforcement learning (PDSRL), for improving goal - oriented map - free navigation based on a simple range - sensing architecture. 2. Demonstrating the feasibility of these methods through simulation - to - real evaluation, solving challenges such as inaccuracy and delay. 3. Evidence shows that the stochastic actor - critic technique using prioritized experience replay is superior to non - distributed techniques and classical algorithms. This is the first extensive simulation - to - real map - free navigation evaluation of ground - moving robots using parallel - distributed deep reinforcement learning methods. Through these contributions, the paper aims to improve the autonomous navigation ability of ground - moving robots in complex environments, especially in the absence of pre - constructed maps.

Parallel Distributional Deep Reinforcement Learning for Mapless Navigation of Terrestrial Mobile Robots

Predictive Hierarchical Reinforcement Learning for Path-Efficient Mapless Navigation with Moving Target.

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Double Deep Reinforcement Learning Techniques for Low Dimensional Sensing Mapless Navigation of Terrestrial Mobile Robots

Enhanced Low-Dimensional Sensing Mapless Navigation of Terrestrial Mobile Robots Using Double Deep Reinforcement Learning Techniques

Double Critic Deep Reinforcement Learning for Mapless 3D Navigation of Unmanned Aerial Vehicles

End-to-End Navigation Strategy with Deep Reinforcement Learning for Mobile Robots

Reinforcement Learning for Navigation of Mobile Robot with LiDAR

Parallel Distributional Prioritized Deep Reinforcement Learning for Unmanned Aerial Vehicles

A Brief Survey: Deep Reinforcement Learning in Mobile Robot Navigation

Deep Reinforcement Learning with Heuristic Corrections for UGV Navigation

Map-less End-to-end Navigation of Mobile Robots Via Deep Reinforcement Learning

Deep-Reinforcement-Learning-Based Semantic Navigation of Mobile Robots in Dynamic Environments

Visual Navigation of Mobile Robots in Complex Environments Based on Distributed Deep Reinforcement Learning

Using Deep Reinforcement Learning with Automatic Curriculum Learning for Mapless Navigation in Intralogistics

Learn to Navigate Autonomously Through Deep Reinforcement Learning

Heuristic Dense Reward Shaping for Learning-Based Map-Free Navigation of Industrial Automatic Mobile Robots

A Behavior-Based Mobile Robot Navigation Method with Deep Reinforcement Learning

Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot

Virtual-to-real Deep Reinforcement Learning: Continuous Control of Mobile Robots for Mapless Navigation