Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Combining Deep Reinforcement Learning with a Jerk-Bounded Trajectory Generator for Kinematically Constrained Motion Planning

Efficient Motion Planning Based on Kinodynamic Model for Quadruped Robots Following Persons in Confined Spaces

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

Integrating DeepRL with Robust Low-Level Control in Robotic Manipulators for Non-Repetitive Reaching Tasks

Bridging the gap between Learning-to-plan, Motion Primitives and Safe Reinforcement Learning

Jerk-bounded and -Continuous Trajectory Planning for a 6-DOF Serial Robot Manipulator with Revolute Joints

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Online Trajectory Generation with Local Replanning for 7-Dof Serial Manipulator in Unforeseen Dynamic Environments

An Efficiently Convergent Deep Reinforcement Learning-Based Trajectory Planning Method for Manipulators in Dynamic Environments

Trajectory Planning for Teleoperated Space Manipulators Using Deep Reinforcement Learning

Collaborative motion planning for multi-manipulator systems through Reinforcement Learning and Dynamic Movement Primitives

Motion planning framework based on dual-agent DDPG method for dual-arm robots guided by human joint angle constraints

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

DynoPlan: Combining Motion Planning and Deep Neural Network based Controllers for Safe HRL

A General Framework of Motion Planning for Redundant Robot Manipulator Based on Deep Reinforcement Learning

Hybrid Trajectory Replanning-Based Dynamic Obstacle Avoidance for Physical Human-Robot Interaction

Trajectory Planning of Robotic Manipulator in Dynamic Environment Exploiting DRL

An Efficient and Responsive Robot Motion Controller for Safe Human-Robot Collaboration

Guided deep reinforcement learning framework using automated curriculum scheme for accurate motion planning

Safe Set-Based Trajectory Planning for Robotic Manipulators

Human Intention-Aware Motion Planning and Adaptive Fuzzy Control for a Collaborative Robot With Flexible Joints