Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Energy-efficient Trajectory Planning for a Class of Industrial Robots Using Parallel Deep Reinforcement Learning

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

An Efficiently Convergent Deep Reinforcement Learning-Based Trajectory Planning Method for Manipulators in Dynamic Environments

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

PathRL: an End-To-End Path Generation Method for Collision Avoidance Via Deep Reinforcement Learning

Deep-Reinforcement-Learning-based Path Planning for Industrial Robots using Distance Sensors as Observation

An Energy-Saving Snake Locomotion Gait Policy Obtained Using Deep Reinforcement Learning

Deep Reinforcement Learning for Indoor Mobile Robot Path Planning

Deep Reinforcement Learning Based Dynamic Route Planning for Minimizing Travel Time

Deep Reinforcement Learning-Based Rehabilitation Robot Trajectory Planning with Optimized Reward Functions

Safe Deep Reinforcement Learning-Based Constrained Optimal Control Scheme for HEV Energy Management

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Deep Reinforcement Learning for Real-Time Energy Management in Smart Home

An End-to-End Path Planner Combining Potential Field Method With Deep Reinforcement Learning

An Adaptive Path Planning Approach for Digital Twin-Enabled Robot Arm Based on Inverse Kinematics and Deep Reinforcement Learning

Energy-Optimal Planning of Robot Trajectory Based on Dynamics

Energy Consumption Minimization of Quadruped Robot Based on Reinforcement Learning of DDPG Algorithm

Energy-aware Task Scheduling Optimization with Deep Reinforcement Learning for Large-Scale Heterogeneous Systems

Transfer Deep Reinforcement Learning-enabled Energy Management Strategy for Hybrid Tracked Vehicle

Multi-Objective Optimal Trajectory Planning for Robotic Arms Using Deep Reinforcement Learning

Data-driven Energy Evaluation and Optimization Method for Industrial Robots