Abstract:Traditional Reinforcement Learning (RL) approaches are designed to work well in static environments. In many real-world scenarios, the environments are complex and dynamic, in which the performance of traditional RL approaches may drastically degrade. One of the factors which results in the dynamicity and complexity of the environment is a change in the position and number of obstacles. This paper presents a path planning approach for autonomous mobile robots in a complex dynamic indoor environment, where the dynamic pattern of obstacles will not drastically affect the performance of RL models. Two independent modules, collision avoidance without considering the goal position and goal-seeking without considering obstacles avoidance, are trained independently using artificial neural networks and RL to obtain their best control policies. Then, a switching function is used to combine the two trained modules for realizing the obstacle avoidance and global path planning in a complex dynamic indoor environment. Furthermore, this control system is designed with a special focus on the computational and memory requirements of resource-constrained robots. The design was tested in a real-world environment on a mini-robot with constrained resources. Along with the static and dynamic obstacles’ avoidance, this system has the ability to achieve both static and dynamic targets. This control system can also be used to train a robot in the real world using RL when the robot cannot afford to collide. Robot behavior in the real ground shows a very strong correlation with the simulation results.

Path Planning and Information Protection of Mobile Robots Based on Deceptive Reinforcement Learning

Real-Time Path Planning for Mobile Robots

On-line Real-Time Path Planning of Mobile Robots in Dynamic Uncertain Environment

Path Planning for Autonomous Mobile Robot In Unknown Environments

RL and ANN Based Modular Path Planning Controller for Resource-Constrained Robots in the Indoor Complex Dynamic Environment

Reinforcement Learning-Based Path Planning Algorithm for Mobile Robots

Reinforcement Learning-Based Continuous Action Space Path Planning Method for Mobile Robots

Deep Reinforcement Learning for Mobile Robot Path Planning

Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

A Path Planning Algorithm Based on Deep Reinforcement Learning for Mobile Robots in Unknown Environment

Path Planning Method of Mobile Robot Using Improved Deep Reinforcement Learning

A Review of Mobile Robot Path Planning Based on Deep Reinforcement Learning Algorithm

A Method to Plan the Path of a Robot Utilizing Deep Reinforcement Learning and Multi-Sensory Information Fusion

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

A Deep Q-network (DQN) Based Path Planning Method for Mobile Robots

Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Informative Path Planning for Mobile Sensing with Reinforcement Learning

Immune deep reinforcement learning-based path planning for mobile robot in unknown environment

A path planning approach for mobile robots using short and safe Q-learning.

A Mapless Local Path Planning Approach Using Deep Reinforcement Learning Framework

Mapless Path Planning of Multi-robot Systems in Complex Environments Via Deep Reinforcement Learning