Abstract:Deep reinforcement learning has demonstrated flexibility advantages in the control field of quadrotor aircraft. However, when there are sudden disturbances in the environment, especially special disturbances beyond experience, the algorithm often finds it difficult to maintain good control performance. Additionally, due to the randomness in the algorithm’s exploration of states, the model’s improvement efficiency during the training process is low and unstable. To address these issues, we propose a deep reinforcement learning framework guided by Multi-PID Self-Attention to tackle the challenges in the training speed and environmental adaptability of quadrotor aircraft control algorithms. In constructing the simulation experiment environment, we introduce multiple disturbance models to simulate complex situations in the real world. By combining the PID control strategy with deep reinforcement learning and utilizing the multi-head self-attention mechanism to optimize the state reward function in the simulation environment, this framework achieves an efficient and stable training process. This experiment aims to train a quadrotor simulation model to accurately fly to a predetermined position under various disturbance conditions and subsequently maintain a stable hovering state. The experimental results show that, compared with traditional deep reinforcement learning algorithms, this method achieves significant improvements in training efficiency and state exploration ability. At the same time, this study deeply analyzes the application effect of the algorithm in different complex environments, verifies its superior robustness and generalization ability in dealing with environmental disturbances, and provides a new solution for the intelligent control of quadrotor aircraft.

Disturbance Rejection and High Dynamic Quadrotor Control Based on Reinforcement Learning and Supervised Learning

Reinforcement Learning‐based Tracking Control for a Quadrotor Unmanned Aerial Vehicle under External Disturbances

Enhancing Quadrotor Control Robustness with Multi-Proportional–Integral–Derivative Self-Attention-Guided Deep Reinforcement Learning

Position Tracking and Attitude Control for Quadrotors Via Active Disturbance Rejection Control Method

Adaptive Fault-Tolerant Control of a Quadrotor Helicopter Based on Sliding Mode Control and Radial Basis Function Neural Network

Control of UAV Quadrotor Using Reinforcement Learning and Robust Controller

Exponential Sliding Mode Control Based on a Neural Network and Finite-Time Disturbance Observer for an Autonomous Aerial Vehicle Exposed to Environmental Disturbances and Parametric Uncertainties

Quadrotor Control Using Reinforcement Learning under Wind Disturbance

Robust Reinforcement Learning Control for a Quadrotor with Disturbance Compensation

Quadrotor Aerobatic Maneuver Attitude Controller Based on Reinforcement Learning.

The Design of Quadrotor UAV Based on Nonlinear Active Disturbance Rejection Control

Disturbance Rejection Attitude Control for a Quadrotor: Theory and Experiment

Adaptive Neural Dynamic Surface Attitude Control of a Quadrotor

Neural network fuzzy control for enhancing the stability performance of quad-rotor helicopter

Supplementary Reinforcement Learning Controller Designed for Quadrotor UAVs.

Predictor-Based Neural Attitude Control of A Quadrotor with Disturbances

Adaptive RBFNNs/integral Sliding Mode Control for a Quadrotor Aircraft.

Quadrotor motion control using deep reinforcement learning

Aggressive and robust low-level control and trajectory tracking for quadrotors with deep reinforcement learning

Immersion and Invariance-based Adaptive Control for Quadrotor Transportation Systems Using Deep Reinforcement Learning

Disturbance Observer and Adaptive Control for Disturbance Rejection of Quadrotor: A Survey