Abstract:This paper presents an intelligent control scheme for multirotors, where accurate trajectory tracking, strong robustness and reliable generalization are guaranteed by the dual-feedback sliding-mode (DFSM) guided deep reinforcement learning (RL). Different from current solutions, the proposed method explores optimal learning strategy on the sliding surface according to the DFSM demonstrations, where the elegantly designed parallel evaluation takes full advantage of model knowledge and learning exploration. Specifically, the intelligent tracking control is achieved in a two-step design. First, the DFSM algorithm is designed for multirotors, where the linear and nonlinear feedback terms work cooperatively. Second, the DFSM-guided deep RL is put forward to achieve intelligent switching on the sliding surface, where position and velocity errors are both considered to generate accurate switching decisions. In the framework, explorations and the DFSM demonstrations are evaluated in parallel, where only the explorations that are better than the DFSM baseline, are kept for policy improvement. In this way, the DFSM algorithm keeps pushing the RL policy to explore better strategy, where the unavoidable bad experiences arisen from exploration are identified accurately. Practical comparative experimental results are included to verify the effectiveness of the proposed strategy. Note to Practitioners—This paper is motivated by the practical problem of controlling multirotor system in uncertain environments. Up until now, most existing approaches are proposed without taking full advantage of model knowledge and deep learning techniques simultaneously, which lacks of reliability in practical application. To deal with the problem, a new dual-feedback sliding-mode (DFSM) guided deep reinforcement learning (RL) strategy is proposed, where the dual feedback and guided RL are designed to achieve satisfactory tracking control and simultaneously handle uncertainties. Specifically, by introducing double-check framework, the RL strategy explores optimal switching policy on the sliding surface according to the DFSM demonstrations, guaranteeing strong robustness and reliable generalization of the obtained RL policy in uncertain environments. The key feature of the framework is that the DFSM-driven training guarantees practice-oriented tracking control in a DFSM-RL cooperative manner. Comparative experiments are implemented to verify the tracking performance of the proposed intelligent control strategy.

Trajectory Tracking Control of Variable Sweep Aircraft Based on Reinforcement Learning

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

Learning the Dynamics of Flapping Wing Robots via Gaussian Process Regression during Three-Dimensional Trajectory Tracking.

Adaptive Sliding Mode Control with Transition Process for Flapping Wing Aerial Vehicle

Trajectory Planning for Airborne Radar in Extended Target Tracking Based on Deep Reinforcement Learning

Adaptive Extremum Seeking Controller Via Nonlinear Variable Gain for Uncertainty Model Multirotor

Target Tracking Control of UAV Through Deep Reinforcement Learning

A novel iterative learning control method for longitudinal trajectory tracking of aerospace vehicles

Wing Kinematics-Based Flight Control Strategy in Insect-Inspired Flight Systems: Deep Reinforcement Learning Gives Solutions and Inspires Controller Design in Flapping MAVs

Target tracking strategy using deep deterministic policy gradient

Integrated 3‐D Flight Trajectory Tracking Control with Aerodynamic Constraints on Attitude and Control Surfaces

USV Trajectory Tracking Control Based on Receding Horizon Reinforcement Learning

Learning-based Trajectory Tracking for Bird-inspired Flapping-Wing Robots

Trajectory tracking control of wheeled mobile robot based on improved LSTM-DDPG algorithm

Path tracking control based on Deep reinforcement learning in Autonomous driving

Deep Reinforcement Learning Automatic Landing Control of Fixed-Wing Aircraft Using Deep Deterministic Policy Gradient

Reinforcement Learning for Dual-Control Aircraft Six-Degree-of-Freedom Attitude Control with System Uncertainty

Trajectory Tracking Control Based on Improved Particle Swarm Optimization

PID Controller Based on Improved DDPG for Trajectory Tracking Control of USV

An Adaptive Hierarchical Trajectory Following Control Approach of Autonomous Four-Wheel Independent Drive Electric Vehicles.

A Novel Guided Deep Reinforcement Learning Tracking Control Strategy for Multirotors