Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Path Planning in Dynamic Environments through Trajectory Prediction and Reinforcement Learning

On-line Real-Time Path Planning of Mobile Robots in Dynamic Uncertain Environment

RL and ANN Based Modular Path Planning Controller for Resource-Constrained Robots in the Indoor Complex Dynamic Environment

Dynamic Path Planning for Mobile Robots with Deep Reinforcement Learning

Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning

Predictive Probability Path Planning Model For Dynamic Environments

Dynamic path planning of mobile robots using adaptive dynamic programming

Reinforcement learning-based dynamic obstacle avoidance and integration of path planning

A deep reinforcement learning based method for real-time path planning and dynamic obstacle avoidance

A Dynamic Subgoal Path Planner for Unpredictable Environments

Real-time local path planning strategy based on deep distributional reinforcement learning

A Model Based Path Planning Algorithm for Self-Driving Cars in Dynamic Environment

Path Planning of Autonomous Mobile Robot in Comprehensive Unknown Environment Using Deep Reinforcement Learning

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Dynamic Path Planning for Robot Navigation Using Sonor Mapping and Neural Networks

Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments

Learning Dynamic Weight Adjustment for Spatial-Temporal Trajectory Planning in Crowd Navigation

Learning-based Motion Planning in Dynamic Environments Using GNNs and Temporal Encoding

Enhancing Offline Coverage Path Planning with Deep Reinforcement Learning

Dynamic Neural Potential Field: Online Trajectory Optimization in Presence of Moving Obstacles

Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot