Abstract:In fact, optimizing path within short computation time still remains a major challenge for mobile robotics applications. In path planning and obstacles avoidance, Q-Learning (QL) algorithm has been widely used as a computational method of learning through environment interaction. However, less emphasis is placed on path optimization using QL because of its slow and weak convergence toward optimal solutions. Therefore, this paper proposes an Efficient Q-Learning (EQL) algorithm to overcome these limitations and ensure an optimal collision-free path in less possible time. In the QL algorithm, successful learning is closely dependent on the design of an effective reward function and an efficient selection strategy for an optimal action that ensures exploration and exploitation. In this regard, a new reward function is proposed to initialize the Q-table and provide the robot with prior knowledge of the environment, followed by a new efficient selection strategy proposal to accelerate the learning process through search space reduction while ensuring a rapid convergence toward an optimized solution. The main idea is to intensify research at each learning stage, around the straight-line segment linking the current position of the robot to <math>Target</math> (optimal path in terms of length). During the learning process, the proposed strategy favors promising actions that not only lead to an optimized path but also accelerate the convergence of the learning process. The proposed EQL algorithm is first validated using benchmarks from the literature, followed by a comparison with other existing QL-based algorithms. The achieved results showed that the proposed EQL gained good learning proficiency; besides, the training performance is significantly improved compared to the state-of-the-art. Concluded, EQL improves the quality of the paths in terms of length, computation time and robot safety, furthermore outperforms other optimization algorithms.

Mobile robot navigation method based on improved Q-learning algorithm

An optimized Q-Learning algorithm for mobile robot local path planning

An event-based probabilistic Q-learning method for navigation control of mobile robots

A Quantum-Inspired Q-Learning Algorithm For Indoor Robot Navigation

Improved reinforcement learning algorithm for mobile robot path planning

Self-Learning Navigation Strategy of Mobile Robot

A path planning approach for mobile robots using short and safe Q-learning.

An Improved Q-learning Algorithm Based on Exploration Region Expansion Strategy

Improved reinforcement learning path planning algorithm integrating prior knowledge

CLSQL: Improved Q-Learning Algorithm Based on Continuous Local Search Policy for Mobile Robot Path Planning

Optimal path planning approach based on Q-learning algorithm for mobile robots

ETQ-learning: an improved Q-learning algorithm for path planning

A novel Q-learning algorithm based on improved whale optimization algorithm for path planning

Long-range Navigation for Autonomous Robot based on Topo-Mapping and Q-Learning

Inspection Robot Navigation Based on Improved TD3 Algorithm

Mobile Robot Navigation Based on Noisy N-Step Dueling Double Deep Q-Network and Prioritized Experience Replay

Solving the optimal path planning of a mobile robot using improved Q-learning

A Self-Adaptive Double Q-Backstepping Trajectory Tracking Control Approach Based on Reinforcement Learning for Mobile Robots

A Path-Planning Approach Based on Potential and Dynamic Q-Learning for Mobile Robots in Unknown Environment

CVRL BASED NAVIGATION CONTROL OF MOBILE ROBOT

An Improved Dyna-Q Algorithm Inspired by the Forward Prediction Mechanism in the Rat Brain for Mobile Robot Path Planning