Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Trajectory Planning using Transfer Learning and Wireless Sensor Network for Target Search Mobile Robot

A Novel Trajectory Planning Method Based on Trust Region Policy Optimization

Path Planning for Autonomous Mobile Robot In Unknown Environments

Real-Time Path Planning for Mobile Robots

Adaptive Model Prediction Control-Based Multi-Terrain Trajectory Tracking Framework for Mobile Spherical Robots

Target Tracking with Limited Sensing Range in Autonomous Mobile Sensor Networks

Discrete States-Based Trajectory Planning for Nonholonomic Robots

Autonomous Trajectory Planning of Free-floating Robot for Capturing Space Target.

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Research On Trajectory Planning Methods of Mobile Robots Based on SLAM Technology

Collaborative Planning for Catching and Transporting Objects in Unstructured Environments

Local Path Planning of Mobile Robot Based on Long Short-Term Memory Neural Network

A Novel Planning and Tracking Approach for Mobile Robotic Arm in Obstacle Environment

A Novel Sensor-Based Motion Planning Algorithm For Mobile Robots In Unknown Environments

Learning-based intelligent trajectory planning for auto navigation of magnetic robots

Trajectory Planning for Unmanned Aerial Vehicles in Complicated Urban Environments: A Control Network Approach

Local Path Planner for Mobile Robot Considering Future Positions of Obstacles

Autonomous Obstacle Avoidance and Trajectory Planning for Mobile Robot Based on Dual-Loop Trajectory Tracking Control and Improved Artificial Potential Field Method

An End-to-End Trajectory Planning Strategy for Free-floating Space Robots

An Improved Real-Time Path Planning of Mobile Robot in a Complex and Dynamic Environment

Motion Planning of Mobile Robot with Non-holonomic Constraints