Abstract:This paper presents an intelligent control scheme for multirotors, where accurate trajectory tracking, strong robustness and reliable generalization are guaranteed by the dual-feedback sliding-mode (DFSM) guided deep reinforcement learning (RL). Different from current solutions, the proposed method explores optimal learning strategy on the sliding surface according to the DFSM demonstrations, where the elegantly designed parallel evaluation takes full advantage of model knowledge and learning exploration. Specifically, the intelligent tracking control is achieved in a two-step design. First, the DFSM algorithm is designed for multirotors, where the linear and nonlinear feedback terms work cooperatively. Second, the DFSM-guided deep RL is put forward to achieve intelligent switching on the sliding surface, where position and velocity errors are both considered to generate accurate switching decisions. In the framework, explorations and the DFSM demonstrations are evaluated in parallel, where only the explorations that are better than the DFSM baseline, are kept for policy improvement. In this way, the DFSM algorithm keeps pushing the RL policy to explore better strategy, where the unavoidable bad experiences arisen from exploration are identified accurately. Practical comparative experimental results are included to verify the effectiveness of the proposed strategy. Note to Practitioners—This paper is motivated by the practical problem of controlling multirotor system in uncertain environments. Up until now, most existing approaches are proposed without taking full advantage of model knowledge and deep learning techniques simultaneously, which lacks of reliability in practical application. To deal with the problem, a new dual-feedback sliding-mode (DFSM) guided deep reinforcement learning (RL) strategy is proposed, where the dual feedback and guided RL are designed to achieve satisfactory tracking control and simultaneously handle uncertainties. Specifically, by introducing double-check framework, the RL strategy explores optimal switching policy on the sliding surface according to the DFSM demonstrations, guaranteeing strong robustness and reliable generalization of the obtained RL policy in uncertain environments. The key feature of the framework is that the DFSM-driven training guarantees practice-oriented tracking control in a DFSM-RL cooperative manner. Comparative experiments are implemented to verify the tracking performance of the proposed intelligent control strategy.

DRL-Based Trajectory Tracking for Motion-Related Modules in Autonomous Driving

Constrained Reinforcement Learning for Vehicle Motion Planning with Topological Reachability Analysis

SRL-TR2: A Safe Reinforcement Learning Based TRajectory TRacker Framework

A RDA-Based Deep Reinforcement Learning Approach for Autonomous Motion Planning of UAV in Dynamic Unknown Environments

Learning to Drive Like Human Beings: A Method Based on Deep Reinforcement Learning

A Learning-Based Flexible Autonomous Motion Control Method for UAV in Dynamic Unknown Environments

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Design and Experimental Validation of Deep Reinforcement Learning-Based Fast Trajectory Planning and Control for Mobile Robot in Unknown Environment

Reinforcement-Tracking: An Effective Trajectory Tracking and Navigation Method for Autonomous Urban Driving

Deep Reinforcement Learning with Intervention Module for Autonomous Driving.

Autonomous Motion Decision-making based on Deep Reinforcement Learning for Autonomous Driving

Reinforced Imitative Trajectory Planning for Urban Automated Driving

Data Informed Residual Reinforcement Learning for High-Dimensional Robotic Tracking Control

Deep Reinforcement Learning for Motion Control Algorithms in Robotics

Deep Reinforcement Learning Based Tracking Control of Unmanned Vehicle with Safety Guarantee.

Intelligent Land Vehicle Model Transfer Trajectory Planning Method Based on Deep Reinforcement Learning

Trajectory tracking control based on deep reinforcement learning and ensemble random network distillation for robotic manipulator

A Novel Guided Deep Reinforcement Learning Tracking Control Strategy for Multirotors

Distributed Drive Autonomous Vehicle Trajectory Tracking Control Based on Multi-Agent Deep Reinforcement Learning

Three-Dimensional Autonomous Entry Trajectory Planning Via Hybrid Action Reinforcement Learning

Deep Reinforcement Learning Multi-UAV Trajectory Control for Target Tracking