Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Deep Reinforcement Learning for Rendezvous Guidance with Enhanced Angles-Only Observability

Spacecraft Attitude Maneuver Planning Based on Deep Reinforcement Learning under Complex Constraints

Multi-constrained Intelligent Gliding Guidance Via Optimal Control and DQN

Neural-Rendezvous: Provably Robust Guidance and Control to Encounter Interstellar Objects

Deep Bayesian Reinforcement Learning for Spacecraft Proximity Maneuvers and Docking

Neural network-based reinforcement learning control for combined spacecraft attitude tracking maneuvers

Path Planning of 6-DOF Free-Floating Space Robotic Manipulators Using Reinforcement Learning

High-dynamic Intelligent Maneuvering Guidance Strategy Via Deep Reinforcement Learning

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Learning With Stochastic Guidance for Robot Navigation

Adaptive Guidance and Integrated Navigation with Reinforcement Meta-Learning

Learning to Guide: Guidance Law Based on Deep Meta-learning and Model Predictive Path Integral Control

Reinforcement learning for angle-only intercept guidance of maneuvering targets

Adaptive Leader-Follower Formation Control and Obstacle Avoidance via Deep Reinforcement Learning

Intelligent Diving Guidance with Terminal Angle and Velocity Constraints Via Deep Reinforcement Learning

Enhancing Robotic Navigation: An Evaluation of Single and Multi-Objective Reinforcement Learning Strategies

Deep Recurrent Reinforcement Learning for Intercept Guidance Law under Partial Observability

Optimal Multi-impulse Linear Rendezvous Via Reinforcement Learning