Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Reinforcement Learning Control of a Real Mobile Robot Using Approximate Policy Iteration

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

A Path-Integral-Based Reinforcement Learning Algorithm for Path Following of an Autoassembly Mobile Robot

Learning with Training Wheels: Speeding up Training with a Simple Controller for Deep Reinforcement Learning

A Self-adaptive LSAC-PID Approach based on Lyapunov Reward Shaping for Mobile Robots

A Self-Adaptive Double Q-Backstepping Trajectory Tracking Control Approach Based on Reinforcement Learning for Mobile Robots

Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning

Human-in-the-loop Distributed Cooperative Tracking Control with Applications to Autonomous Ground Vehicles: A Data-Driven Mixed Iteration Approach

Beyond Imitation: A Life-long Policy Learning Framework for Path Tracking Control of Autonomous Driving

Model-Based Reinforcement Learning Inspired by Augmented PD for Robotic Control

Trajectory Tracking of Wheeled Mobile Robot by Adopting Iterative Learning Control with Predictive, Current, and Past Learning Items

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

A Hierarchical Reinforcement Learning Approach to Control Legged Mobile Manipulators

Enabling Efficient, Reliable Real-World Reinforcement Learning with Approximate Physics-Based Models

Real–Sim–Real Transfer for Real-World Robot Control Policy Learning with Deep Reinforcement Learning

Real-Robot Deep Reinforcement Learning: Improving Trajectory Tracking of Flexible-Joint Manipulator with Reference Correction

Robot target localization and interactive multi-mode motion trajectory tracking based on adaptive iterative learning

A learning-based control pipeline for generic motor skills for quadruped robots

A Self-adaptive SAC-PID Control Approach based on Reinforcement Learning for Mobile Robots

Modelling, Positioning, and Deep Reinforcement Learning Path Tracking Control of Scaled Robotic Vehicles: Design and Experimental Validation

Learning Bipedal Walking for Humanoids with Current Feedback