Abstract:Traditional Reinforcement Learning (RL) approaches are designed to work well in static environments. In many real-world scenarios, the environments are complex and dynamic, in which the performance of traditional RL approaches may drastically degrade. One of the factors which results in the dynamicity and complexity of the environment is a change in the position and number of obstacles. This paper presents a path planning approach for autonomous mobile robots in a complex dynamic indoor environment, where the dynamic pattern of obstacles will not drastically affect the performance of RL models. Two independent modules, collision avoidance without considering the goal position and goal-seeking without considering obstacles avoidance, are trained independently using artificial neural networks and RL to obtain their best control policies. Then, a switching function is used to combine the two trained modules for realizing the obstacle avoidance and global path planning in a complex dynamic indoor environment. Furthermore, this control system is designed with a special focus on the computational and memory requirements of resource-constrained robots. The design was tested in a real-world environment on a mini-robot with constrained resources. Along with the static and dynamic obstacles’ avoidance, this system has the ability to achieve both static and dynamic targets. This control system can also be used to train a robot in the real world using RL when the robot cannot afford to collide. Robot behavior in the real ground shows a very strong correlation with the simulation results.

Adapting Real Mobile Robots to Complex Environments Using a Pattern Association Network Controller (PAN-C).

Adaptive Locomotion Control of a Hexapod Robot Via Bio-Inspired Learning

RL and ANN Based Modular Path Planning Controller for Resource-Constrained Robots in the Indoor Complex Dynamic Environment

A Hierarchical Autonomous Robot Controller for Learning and Memory: Adaptation in a Dynamic Environment.

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Cooperative Flocking And Learning In Multi-Robot Systems For Predator Avoidance

Environmental Adaptation of Robot Morphology and Control Through Real-World Evolution

Evolution of Cooperative Ensemble Neural Network Controller for Autonomous Mobile Robots

A comparison of controller architectures and learning mechanisms for arbitrary robot morphologies

Intelligent Enhanced Mobile Robotics Navigation: Integrating Neural Networks with Type-2 Fuzzy Logic for Dynamic Environments

Neural Networks Enhanced Adaptive Admittance Control of Optimized Robot–Environment Interaction

Multi-Layered And Hybrid Control Of Autonomous Mobile Robot

Self-Organizing Brain Emotional Learning Controller Network for Intelligent Control System of Mobile Robots

A Spiking Neural Network With Dynamic Memory For A Real Autonomous Mobile Robot In Dynamic Environment

A Simple Aplysia-Like Spiking Neural Network to Generate Adaptive Behavior in Autonomous Robots

Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces

Adaptive Neural Network Control and Learning for Robot Manipulator

Robot target tracking control considering obstacle avoidance based on combination of deep reinforcement learning and PID

Simultaneous Optimization of Discrete and Continuous Parameters Defining a Robot Morphology and Controller

Towards Behavior Control for Evolutionary Robot Based on Rl with Enn

Elman Neural Network Controller For Behavior-Based Robot