Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Off-road Autonomous Vehicles Traversability Analysis and Trajectory Planning Based on Deep Inverse Reinforcement Learning

Path Planning Technology of Unmanned Vehicle Based on Improved Deep Reinforcement Learning

Constrained Reinforcement Learning for Vehicle Motion Planning with Topological Reachability Analysis

Integrating kinematics and environment context into deep inverse reinforcement learning for predicting off-road vehicle trajectories

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Deep Reinforcement Learning-based Off-road Path Planning Via Low-dimensional Simulation

Intelligent Land Vehicle Model Transfer Trajectory Planning Method Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Autonomous Ground Vehicle Exploration Without A-Priori Maps

Deep Reinforcement Learning-based Multi-objective Path Planning on the Off-road Terrain Environment for Ground Vehicles

Autonomous Navigation of UAV in Multi-Obstacle Environments Based on a Deep Reinforcement Learning Approach

EVORA: Deep Evidential Traversability Learning for Risk-Aware Off-Road Autonomy

Maximum Entropy Inverse Reinforcement Learning-Based Trajectory Planning for Autonomous Driving

The Impact of LiDAR Configuration on Goal-Based Navigation within a Deep Reinforcement Learning Framework

HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks

Research on Anthropomorphic Obstacle Avoidance Trajectory Planning for Adaptive Driving Scenarios Based on Inverse Reinforcement Learning Theory

Deep, Consistent Behavioral Decision Making with Planning Features for Autonomous Vehicles

Autonomous Navigation by Mobile Robot with Sensor Fusion Based on Deep Reinforcement Learning

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

CoverNav: Cover Following Navigation Planning in Unstructured Outdoor Environment with Deep Reinforcement Learning

Exploration Without Maps via Zero-Shot Out-of-Distribution Deep Reinforcement Learning

RoadRunner -- Learning Traversability Estimation for Autonomous Off-road Driving