Abstract:Deep reinforcement learning has demonstrated flexibility advantages in the control field of quadrotor aircraft. However, when there are sudden disturbances in the environment, especially special disturbances beyond experience, the algorithm often finds it difficult to maintain good control performance. Additionally, due to the randomness in the algorithm’s exploration of states, the model’s improvement efficiency during the training process is low and unstable. To address these issues, we propose a deep reinforcement learning framework guided by Multi-PID Self-Attention to tackle the challenges in the training speed and environmental adaptability of quadrotor aircraft control algorithms. In constructing the simulation experiment environment, we introduce multiple disturbance models to simulate complex situations in the real world. By combining the PID control strategy with deep reinforcement learning and utilizing the multi-head self-attention mechanism to optimize the state reward function in the simulation environment, this framework achieves an efficient and stable training process. This experiment aims to train a quadrotor simulation model to accurately fly to a predetermined position under various disturbance conditions and subsequently maintain a stable hovering state. The experimental results show that, compared with traditional deep reinforcement learning algorithms, this method achieves significant improvements in training efficiency and state exploration ability. At the same time, this study deeply analyzes the application effect of the algorithm in different complex environments, verifies its superior robustness and generalization ability in dealing with environmental disturbances, and provides a new solution for the intelligent control of quadrotor aircraft.

Neural Moving Horizon Estimation for Robust Flight Control

Trust-Region Neural Moving Horizon Estimation for Robots

Internal and External Disturbances Aware Motion Planning and Control for Quadrotors

Efficient Learning-based Trajectory Tacker for Quadrotor at High-speed Flight

Adaptive Extremum Seeking Controller Via Nonlinear Variable Gain for Uncertainty Model Multirotor

Full Backstepping Control in Dynamic Systems With Air Disturbances Optimal Estimation of a Quadrotor

Adaptive Model Predictive Control Based on Neural Networks for Hover Attitude Tracking with Input Saturation and Unknown Disturbances

Robust Tracking Control for Quadrotor UAV With External Disturbances and Uncertainties Using Neural Network Based MRAC

Estimator-based MLP Neuroadaptive Dynamic Surface Containment Control with Prescribed Performance for Multiple Quadrotors

Extreme Learning Machine Assisted Adaptive Control of a Quadrotor Helicopter

Neural Internal Model Control: Learning a Robust Control Policy via Predictive Error Feedback

Hybrid Offline–online Neural Identification-Based Robust Adaptive Tracking Control for Quadrotors

Robust tracking control strategy for a quadrotor using RPD-SMC and RISE

External Forces Resilient Safe Motion Planning for Quadrotor

Nonlinear MPC for Quadrotors in Close-Proximity Flight with Neural Network Downwash Prediction

End-to-end Neural Network Based Quadcopter control

Deterministic Policy Gradient with Integral Compensator for Robust Quadrotor Control

Neuroadaptive integral robust control of visual quadrotor for tracking a moving object

Neural Network Based Model Predictive Control for a Quadrotor UAV

Meta-Learning Augmented MPC for Disturbance-Aware Motion Planning and Control of Quadrotors

Enhancing Quadrotor Control Robustness with Multi-Proportional–Integral–Derivative Self-Attention-Guided Deep Reinforcement Learning