Abstract:In fact, optimizing path within short computation time still remains a major challenge for mobile robotics applications. In path planning and obstacles avoidance, Q-Learning (QL) algorithm has been widely used as a computational method of learning through environment interaction. However, less emphasis is placed on path optimization using QL because of its slow and weak convergence toward optimal solutions. Therefore, this paper proposes an Efficient Q-Learning (EQL) algorithm to overcome these limitations and ensure an optimal collision-free path in less possible time. In the QL algorithm, successful learning is closely dependent on the design of an effective reward function and an efficient selection strategy for an optimal action that ensures exploration and exploitation. In this regard, a new reward function is proposed to initialize the Q-table and provide the robot with prior knowledge of the environment, followed by a new efficient selection strategy proposal to accelerate the learning process through search space reduction while ensuring a rapid convergence toward an optimized solution. The main idea is to intensify research at each learning stage, around the straight-line segment linking the current position of the robot to <math>Target</math> (optimal path in terms of length). During the learning process, the proposed strategy favors promising actions that not only lead to an optimized path but also accelerate the convergence of the learning process. The proposed EQL algorithm is first validated using benchmarks from the literature, followed by a comparison with other existing QL-based algorithms. The achieved results showed that the proposed EQL gained good learning proficiency; besides, the training performance is significantly improved compared to the state-of-the-art. Concluded, EQL improves the quality of the paths in terms of length, computation time and robot safety, furthermore outperforms other optimization algorithms.

GOAL SEEKING OF MOBILE ROBOTS USING DYNAMIC FUZZY Q-LEARNING

Real-time Dynamic Fuzzy Q-learning and Control of Mobile Robots

Dynamic fuzzy Q-learning and control of mobile robots

Fuzzy Logic Navigation of Mobile Robot with On-line Self-learning

Self-Learning in Obstacle Avoidance of a Mobile Robot via Dynamic Self-Generated Fuzzy Q-Learning

Obstacle avoidance strategy for biped robot based on fuzzy q-learning

Probabilistic Roadmap With Self-Learning For Path Planning Of A Mobile Robot In A Dynamic And Unstructured Environment

Dynamic Fuzzy Q-Learning and Its Real-Time Application in Embedded System

Automatic generation of fuzzy inference systems by dynamic fuzzy Q-learning

Dynamic Self-Generated Fuzzy Systems for Reinforcement Learning.

Genetic algorithm fuzzy based dynamic motion planning approach for a mobile robot

Navigation for Mobile Robots Using Reinforcement Learning and Fuzzy Logic

Q-Learning Based Method Of Adaptive Path Planning For Mobile Robot

Experimental Research on Avoidance Obstacle Control for Mobile Robots Using Q-Learning (QL) and Deep Q-Learning (DQL) Algorithms in Dynamic Environments

Behavior-Based Fuzzy Control for Mobile Robot Navigation

Random Neural Q-Learning for Obstacle Avoidance of A Mobile Robot in Unknown Environments

An optimized Q-Learning algorithm for mobile robot local path planning

Reinforcement Learning For Mobile Robot Obstacle Avoidance Under Dynamic Environments

Q-learning Based on Neural Network in Learning Action Selection of Mobile Robot

Optimal path planning approach based on Q-learning algorithm for mobile robots

Optimal Path Planning Based on Goal Heuristics IQLA for Mobile Robots