Abstract:This article is concerned with the problem of planning optimal maneuver trajectories and guiding the mobile robot toward target positions in uncertain environments for exploration purposes. A hierarchical deep learning-based control framework is proposed which consists of an upper level motion planning layer and a lower level waypoint tracking layer. In the motion planning phase, a recurrent deep neural network (RDNN)-based algorithm is adopted to predict the optimal maneuver profiles for the mobile robot. This approach is built upon a recently proposed idea of using deep neural networks (DNNs) to approximate the optimal motion trajectories, which has been validated that a fast approximation performance can be achieved. To further enhance the network prediction performance, a recurrent network model capable of fully exploiting the inherent relationship between preoptimized system state and control pairs is advocated. In the lower level, a deep reinforcement learning (DRL)-based collision-free control algorithm is established to achieve the waypoint tracking task in an uncertain environment (e.g., the existence of unexpected obstacles). Since this approach allows the control policy to directly learn from human demonstration data, the time required by the training process can be significantly reduced. Moreover, a noisy prioritized experience replay (PER) algorithm is proposed to improve the exploring rate of control policy. The effectiveness of applying the proposed deep learning-based control is validated by executing a number of simulation and experimental case studies. The simulation result shows that the proposed DRL method outperforms the vanilla PER algorithm in terms of training speed. Experimental videos are also uploaded, and the corresponding results confirm that the proposed strategy is able to fulfill the autonomous exploration mission with improved motion planning performance, enhanced collision avoidance ability, and less training time.

Dynamic fuzzy Q-learning and control of mobile robots

Dynamic Fuzzy Q-Learning and Its Real-Time Application in Embedded System

Path Planning for Mobile Robot Based on Deep Reinforcement Learning and Fuzzy Control

A New Type-3 Fuzzy Predictive Approach for Mobile Robots

A Self-Adaptive Double Q-Backstepping Trajectory Tracking Control Approach Based on Reinforcement Learning for Mobile Robots

Experimental Research on Avoidance Obstacle Control for Mobile Robots Using Q-Learning (QL) and Deep Q-Learning (DQL) Algorithms in Dynamic Environments

Reinforcement Learning For Mobile Robot Obstacle Avoidance Under Dynamic Environments

Fuzzy Logic Control for Indoor Navigation of Mobile Robots

Obstacle avoidance strategy for biped robot based on fuzzy q-learning

Navigation for Mobile Robots Using Reinforcement Learning and Fuzzy Logic

Learning Fuzzy Controllers in Mobile Robotics with Embedded Preprocessing

Fuzzy Q-Learning interaction controller design for collaborative robot

Sensor-based robot navigation in uncertain environments using fuzzy logic

An improved fuzzy inference strategy using reinforcement learning for trajectory-tracking of a mobile robot under a varying slip ratio

Real-time self-reaction of mobile robot with genetic fuzzy neural network in unknown environment

Mobile Robot Path Tracking In Unknown Dynamic Environment

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Shortest Path Planning and Efficient Fuzzy Logic Control of Mobile Robots in Indoor Static and Dynamic Environments

Fuzzy-based Navigation and Control of a Non-Holonomic Mobile Robot

Fuzzy controller for the autonomous mobile robot path planning

Fuzzy Logic Based Behavior Fusion for Navigat Ion of an Intel L Igent Mobi Le Robot