Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Adaptive Nonlinear Model Predictive Horizon Using Deep Reinforcement Learning for Optimal Trajectory Planning

A Novel Trajectory Planning Method Based on Trust Region Policy Optimization

A Backstepping Approach to Nonlinear Model Predictive Horizon for Optimal Trajectory Planning

Optimal Motion Planning in GPS-Denied Environments Using Nonlinear Model Predictive Horizon

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Trajectory Planning with Deep Reinforcement Learning in High-Level Action Spaces

Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control

Fast Trajectory Planning for Automated Vehicles Using Gradient-Based Nonlinear Model Predictive Control

Gradient-Based Trajectory Optimization With Learned Dynamics

Trajectory Planning for Autonomous Vehicles Using Hierarchical Reinforcement Learning

Safe Trajectory Planning Using Reinforcement Learning for Self Driving

Trajectory Planning for Autonomous Vehicle Using Iterative Reward Prediction in Reinforcement Learning

A deep reinforcement learning-based approach to onboard trajectory generation for hypersonic vehicles

An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving

An Efficiently Convergent Deep Reinforcement Learning-Based Trajectory Planning Method for Manipulators in Dynamic Environments

Integrating Decision-Making Into Differentiable Optimization Guided Learning for End-to-End Planning of Autonomous Vehicles

Motion Planner with Fixed-Horizon Constrained Reinforcement Learning for Complex Autonomous Driving Scenarios

Trajectory Planning for Teleoperated Space Manipulators Using Deep Reinforcement Learning

Predictive Maneuver Planning with Deep Reinforcement Learning (PMP-DRL) for comfortable and safe autonomous driving

Model predictive trajectory optimization and tracking for on-road autonomous vehicles