Abstract:Effective real-time autonomous navigation for mobile robots in static and dynamic environments has become a challenging and active research topic. Although the simultaneous localization and mapping (SLAM) algorithm offers a solution, it often heavily relies on complex global and local maps, resulting in significant computational demands, slower convergence rates, and prolonged training times. In response to these challenges, this paper presents a novel algorithm called PER-n2D3QN, which integrates prioritized experience replay, a noisy network with factorized Gaussian noise, n-step learning, and a dueling structure into a double deep Q-network. This combination enhances the efficiency of experience replay, facilitates exploration, and provides more accurate Q-value estimates, thereby significantly improving the performance of autonomous navigation for mobile robots. To further bolster the stability and robustness, meaningful improvements, such as target "soft" updates and the gradient clipping mechanism, are employed. Additionally, a novel and powerful target-oriented reshaping reward function is designed to expedite learning. The proposed model is validated through extensive experiments using the robot operating system (ROS) and Gazebo simulation environment. Furthermore, to more specifically reflect the complexity of the simulation environment, this paper presents a quantitative analysis of the simulation environment. The experimental results demonstrate that PER-n2D3QN exhibits heightened accuracy, accelerated convergence rates, and enhanced robustness in both static and dynamic scenarios.

A Quantum-Inspired Q-Learning Algorithm For Indoor Robot Navigation

Quantum Deep Reinforcement Learning for Robot Navigation Tasks

Mobile robot navigation method based on improved Q-learning algorithm

An event-based probabilistic Q-learning method for navigation control of mobile robots

An autonomous mobile robot based on quantum algorithm

Reinforcement Learning for Navigation of Mobile Robot with LiDAR

An optimized Q-Learning algorithm for mobile robot local path planning

Experimental Research on Avoidance Obstacle Control for Mobile Robots Using Q-Learning (QL) and Deep Q-Learning (DQL) Algorithms in Dynamic Environments

Intelligent Navigation of Indoor Robot Based on Improved DDPG Algorithm

Nav-Q: Quantum Deep Reinforcement Learning for Collision-Free Navigation of Self-Driving Cars

Research on Autonomous Robots Navigation based on Reinforcement Learning

Quantum Imitation Learning

Mimicking Human Intuition: Cognitive Belief-Driven Q-Learning

An Improved Dyna-Q Algorithm Inspired by the Forward Prediction Mechanism in the Rat Brain for Mobile Robot Path Planning

Long-range Navigation for Autonomous Robot based on Topo-Mapping and Q-Learning

Learning to Socially Navigate in Pedestrian-rich Environments with Interaction Capacity

A path planning approach for mobile robots using short and safe Q-learning.

Intelligent mobile robot navigation in unknown and complex environment using reinforcement learning technique

Reinforcement Learning Quantum Local Search

Mobile Robot Navigation Based on Noisy N-Step Dueling Double Deep Q-Network and Prioritized Experience Replay

AI drive: quantum-computational DRL framework for EHV navigational efficiency and security augmentation