Abstract:Deep reinforcement learning has demonstrated flexibility advantages in the control field of quadrotor aircraft. However, when there are sudden disturbances in the environment, especially special disturbances beyond experience, the algorithm often finds it difficult to maintain good control performance. Additionally, due to the randomness in the algorithm’s exploration of states, the model’s improvement efficiency during the training process is low and unstable. To address these issues, we propose a deep reinforcement learning framework guided by Multi-PID Self-Attention to tackle the challenges in the training speed and environmental adaptability of quadrotor aircraft control algorithms. In constructing the simulation experiment environment, we introduce multiple disturbance models to simulate complex situations in the real world. By combining the PID control strategy with deep reinforcement learning and utilizing the multi-head self-attention mechanism to optimize the state reward function in the simulation environment, this framework achieves an efficient and stable training process. This experiment aims to train a quadrotor simulation model to accurately fly to a predetermined position under various disturbance conditions and subsequently maintain a stable hovering state. The experimental results show that, compared with traditional deep reinforcement learning algorithms, this method achieves significant improvements in training efficiency and state exploration ability. At the same time, this study deeply analyzes the application effect of the algorithm in different complex environments, verifies its superior robustness and generalization ability in dealing with environmental disturbances, and provides a new solution for the intelligent control of quadrotor aircraft.

Control of Quadrotor Drone with Partial State Observation Via Reinforcement Learning

Model-free Maneuvering Control of Fixed-Wing UAVs Based on Deep Reinforcement Learning

Control of UAV Quadrotor Using Reinforcement Learning and Robust Controller

Supplementary Reinforcement Learning Controller Designed for Quadrotor UAVs.

Multi-Agent Reinforcement Learning for the Low-Level Control of a Quadrotor UAV

Deep Reinforcement Learning-based Quadcopter Controller: A Practical Approach and Experiments

Full control of a quadrotor using parameter-scheduled backstepping method: implementation and experimental tests

Robust Control Strategy for Quadrotor Drone Using Reference Model-Based Deep Deterministic Policy Gradient

Quadrotor motion control using deep reinforcement learning

Evaluation of Reinforcement and Deep Learning Algorithms in Controlling Unmanned Aerial Vehicles

Enhancing Quadrotor Control Robustness with Multi-Proportional–Integral–Derivative Self-Attention-Guided Deep Reinforcement Learning

Deterministic Policy Gradient with Integral Compensator for Robust Quadrotor Control

Event-triggered Reinforcement Learning Control for the Quadrotor UAV with Actuator Saturation

Prescribed Performance Control of Quadrotor with State Constraints

Developmental Reinforcement Learning of Control Policy of a Quadcopter UAV with Thrust Vectoring Rotors

Quadrotor Control Using Reinforcement Learning under Wind Disturbance

Fault-tolerant Control for Unmanned Aerial Vehicle Using Deep Reinforcement Learning

Reinforcement Learning Trajectory Generation and Control for Aggressive Perching on Vertical Walls with Quadrotors

Model-assisted Reinforcement Learning of a Quadrotor

Aggressive and robust low-level control and trajectory tracking for quadrotors with deep reinforcement learning

Reinforcement Learning for UAV Attitude Control