Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Path Planning for Autonomous Driving of Mobile Robots using Deep Neural Network based Model Predictive Control

An Autonomous Robot for Collision-Free Person Following Through Model Predictive Control

Nonlinear Model Predictive Path Tracking Control for Autonomous Vehicles Based on Orthogonal Collocation Method

Path Planning for Autonomous Vehicles Using Model Predictive Control

Collision Avoidance Path Planning and Tracking Control for Autonomous Vehicles Based on Model Predictive Control

An Intelligent Predictive Control Approach to Path Tracking Problem of Autonomous Mobile Robot

Neural Network Model Predictive Motion Control Applied to Automated Driving With Unknown Friction

Deviation Sequence Neural Network Control for Path Tracking of Autonomous Vehicles

MPC-Based Control of Autonomous Vehicles With Localized Path Planning for Obstacle Avoidance Under Uncertainties

Nonlinear Model Predictive Control for Mobile Medical Robot Using Neural Optimization

Real-Time Drift-Driving Control for an Autonomous Vehicle: Learning from Nonlinear Model Predictive Control via a Deep Neural Network

Incorporating Target Vehicle Trajectories Predicted by Deep Learning Into Model Predictive Controlled Vehicles

Nonlinear Model Predictive Control for Mobile Robot Using Varying-Parameter Convergent Differential Neural Network

A Robust Model Predictive Control Strategy for Trajectory Tracking of Omni-directional Mobile Robots

Data-Driven Enhancements for MPC-Based Path Tracking Controller in Autonomous Vehicles

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Path Planning and Predictive Control of Autonomous Vehicles for Obstacle Avoidance

Robust Stabilization of a Wheeled Mobile Robot Using Model Predictive Control Based on Neurodynamics Optimization

Deep Learning-Based NMPC for Local Motion Planning of Last-Mile Delivery Robot

Research for Nonlinear Model Predictive Controls to Laterally Control Unmanned Vehicle Trajectory Tracking

Model Predictive Inferential Control of Neural State-Space Models for Autonomous Vehicle Motion Planning