Abstract:Effective real-time autonomous navigation for mobile robots in static and dynamic environments has become a challenging and active research topic. Although the simultaneous localization and mapping (SLAM) algorithm offers a solution, it often heavily relies on complex global and local maps, resulting in significant computational demands, slower convergence rates, and prolonged training times. In response to these challenges, this paper presents a novel algorithm called PER-n2D3QN, which integrates prioritized experience replay, a noisy network with factorized Gaussian noise, n-step learning, and a dueling structure into a double deep Q-network. This combination enhances the efficiency of experience replay, facilitates exploration, and provides more accurate Q-value estimates, thereby significantly improving the performance of autonomous navigation for mobile robots. To further bolster the stability and robustness, meaningful improvements, such as target "soft" updates and the gradient clipping mechanism, are employed. Additionally, a novel and powerful target-oriented reshaping reward function is designed to expedite learning. The proposed model is validated through extensive experiments using the robot operating system (ROS) and Gazebo simulation environment. Furthermore, to more specifically reflect the complexity of the simulation environment, this paper presents a quantitative analysis of the simulation environment. The experimental results demonstrate that PER-n2D3QN exhibits heightened accuracy, accelerated convergence rates, and enhanced robustness in both static and dynamic scenarios.

Research and Realization of Dynamic Neural Network Navigation Algorithm for Mobile Robot

Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning

Q-Learning Based on Dynamical Structure Neural Network for Robot Navigation in Unknown Environment

Fuzzy Logic Navigation of Mobile Robot with On-line Self-learning

The Mobile Robot Navigation in Dynamic Environment

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Research on Autonomous Robots Navigation based on Reinforcement Learning

Robot Autonomous Navigation Based on Program Learning in Dynamic Environment

A Neural Network-Based Navigation Approach for Autonomous Mobile Robot Systems

Mobile Robot Navigation Based on Noisy N-Step Dueling Double Deep Q-Network and Prioritized Experience Replay

A Method of Autonomous Robot Navigation in Dynamic Unknown Environment

Obstacle Avoidance Navigation Method for Robot Based on Deep Reinforcement Learning

Visual Navigation of Mobile Robots in Complex Environments Based on Distributed Deep Reinforcement Learning

Robot Navigation with Map-Based Deep Reinforcement Learning

Learning Autonomous Navigation in Unmapped and Unknown Environments

Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation

Efficient Reinforcement Learning for 3D LiDAR Navigation of Mobile Robot

Real-Time Navigation For A Mobile Robot Based On The Autonomous Behavior Agent

Navigation of Mobile Robots Based on Deep Reinforcement Learning: Reward Function Optimization and Knowledge Transfer

Research on Target-Driven Navigation of Mobile Robot Based on Deep Reinforcement Learning and Preprocessing Layer

A SELF-LEARNING REACTIVE NAVIGATION