Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Learning to schedule control fragments for physics-based character simulation and robots using deep q-learning

Learning to Schedule Control Fragments for Physics-Based Characters Using Deep Q-Learning

Whole-body Dynamic Collision Avoidance with Time-varying Control Barrier Functions

Learning Accurate and Robust Velocity Tracking for Quadrupedal Robots

Guided Learning of Control Graphs for Physics-Based Characters

Sim-to-Real Transfer Learning using Robustified Controllers in Robotic Tasks involving Complex Dynamics

Complex Locomotion Skill Learning via Differentiable Physics

Learning Agile Flight Maneuvers: Deep SE(3) Motion Planning and Control for Quadrotors

Hierarchical Planning and Control for Box Loco-Manipulation

Neural Categorical Priors for Physics-Based Character Control

Learning basketball dribbling skills using trajectory optimization and deep reinforcement learning

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

RobotKeyframing: Learning Locomotion with High-Level Objectives via Mixture of Dense and Sparse Rewards

Strategy and Skill Learning for Physics-based Table Tennis Animation

A novel simulation reality closed loop learning framework for autonomous robot skill learning

Dexterous Legged Locomotion in Confined 3D Spaces with Reinforcement Learning

Real-time Model Predictive Control and System Identification Using Differentiable Physics Simulation

Fuzzy Q-Learning interaction controller design for collaborative robot

From Simulation to Reality: A Learning Framework for Fish-Like Robots to Perform Control Tasks

Realizing asynchronous finite-time robust tracking control of switched flight vehicles by using nonfragile deep reinforcement learning

Perpetual Humanoid Control for Real-time Simulated Avatars