Abstract:Navigation precision, speed and stability are crucial for safe Unmanned Aerial Vehicle (UAV) flight maneuvers and effective flight mission executions in dynamic environments. Different flight missions may have varying objectives, such as minimizing energy consumption, achieving precise positioning, or maximizing speed. A controller that can adapt to different objectives on the fly is highly valuable. Proportional Integral Derivative (PID) controllers are one of the most popular and widely used control algorithms for drones and other control systems, but their linear control algorithm fails to capture the nonlinear nature of the dynamic wind conditions and complex drone system. Manually tuning the PID gains for various missions can be time-consuming and requires significant expertise. This paper aims to revolutionize drone flight control by presenting the AirPilot, a nonlinear Deep Reinforcement Learning (DRL) - enhanced Proportional Integral Derivative (PID) drone controller using Proximal Policy Optimization (PPO). AirPilot controller combines the simplicity and effectiveness of traditional PID control with the adaptability, learning capability, and optimization potential of DRL. This makes it better suited for modern drone applications where the environment is dynamic, and mission-specific performance demands are high. We employed a COEX Clover autonomous drone for training the DRL agent within the simulator and implemented it in a real-world lab setting, which marks a significant milestone as one of the first attempts to apply a DRL-based flight controller on an actual drone. Airpilot is capable of reducing the navigation error of the default PX4 PID position controller by 90%, improving effective navigation speed of a fine-tuned PID controller by 21%, reducing settling time and overshoot by 17% and 16% respectively.

UAV velocity control based on improved PID algorithm

A Gradient Optimization Based PID Tuning Approach on Quadrotor

Integral Backstepping-based Nonlinear Flight Control Strategy for Quadrotor Aerial Robot with Unknown Mass

Fuzzy Gain-Scheduling PID for UAV Position and Altitude Controllers

Controller design for transition flight of rotor-driven VTOL fixed-wing UAV based on PID

An Application of Fuzzy PID Algorithm on Unmanned Helicopter Attitude Control

Automatic PID Tuning Via Differential Evolution for Quadrotor UAVs Trajectory Tracking

Distributed optimization of heterogeneous UAV cluster PID controller based on machine learning

Modeling and PID control of quadrotor UAV based on machine learning

Achieving stable trajectory tracking in complex environments using an adaptive PID control strategy-based quadcopter drone

Single Neural Adaptive PID Control for Small UAV Micro-Turbojet Engine

Backstepping approach for design of PID controller with guaranteed performance for micro-air UAV

H2 Optimized PID Control of Quad-Copter Platform with Wind Disturbance

Design of flight control system of Quad Tilt Rotor UAV based on PID algorithm

AirPilot: Interpretable PPO-based DRL Auto-Tuned Nonlinear PID Drone Controller for Robust Autonomous Flights

A Robust Adaptive PID-like Controller for Quadrotor Unmanned Aerial Vehicle Systems

A review of research on the control of quadrotor UAVs based on deep learning PID algorithm

Enhanced Whale Optimization Algorithm for Fuzzy Proportional–Integral–Derivative Control Optimization in Unmanned Aerial Vehicles

Review of PID Controller Applications for UAVs

Control and Navigation System for a Fixed-Wing Unmanned Aerial Vehicle

A Velocity Controller for Quadrotors Based on Reinforcement Learning.