Abstract:Notwithstanding the successful design of state-of-the-art cooperative control protocols to accomplish formation tracking for multiple unmanned aerial vehicles (UAVs), the assurance of performance optimality cannot be guaranteed in the face of complex disturbances affecting these multi-UAV systems. In order to surmount this challenge, this research endeavor aims to establish a feedforward-feedback learning-based optimal control methodology to facilitate cooperative UAV formation tracking in the presence of intricate disturbances. To be more precise, by leveraging backstepping-based feedback control, the problem of UAV formation tracking is transformed into an equivalent optimal regulation problem. Consequently, a learning-based feedforward control scheme is devised, wherein the cooperative policy iteration algorithm is formulated based on a two-player zero-sum game. The critic-only echo state network (ESN) is employed to approximate the optimal feedforward control policies, with the inclusion of an online adaptive tuning law and compensation terms to alleviate the persistence of excitation condition and eliminate the need for an initial admissible control. As a result, the closed-loop stability is guaranteed in terms of uniformly ultimately boundedness for tracking errors and ESN weights. Note to Practitioners—In real-world scenarios, the flight of multiple UAVs is invariably affected by intricate disturbances, resulting in compromised tracking precision. There is an urgent need to enhance resistance to disturbances and ensure optimal performance for cooperative formation tracking of multiple UAVs. Beyond the capabilities of model-based controllers, the integration of reinforcement learning has shown promise in achieving robust control actions. By introducing the cooperative policy iteration algorithm based on a two-player zero-sum game, the tracking performances of UAV formation can be further optimized. In order to facilitate the practical application of reinforcement learning in UAV systems, our proposed algorithm addresses the persistency of excitation condition by incorporating innovative compensation terms into the ESN tuning law. Furthermore, we resolve the requirement for initial admissible control by introducing a novel piecewise compensation term into the ESN tuning law, which is based on a newly proposed Lyapunov function.

Extremum seeking control for UAV close formation flight via improved pigeon-inspired optimization

Filter-based Adaptive Backstepping Attitude Control for Multi-Rotor UAVs with Parametric Uncertainty, External Disturbance and Input Saturation

Adaptive Extremum Seeking Controller Via Nonlinear Variable Gain for Uncertainty Model Multirotor

Robust Control for UAV Close Formation Using LADRC via Sine-Powered Pigeon-Inspired Optimization

Source Seeking of UAV Via Adaptive Extremum Seeking Without Steady-state Oscillation

UAV-enabled Integrated Sensing and Communication: Tracking Design and Optimization

Learning-Based Optimal Cooperative Formation Tracking Control for Multiple UAVs: A Feedforward-Feedback Design Framework

Vertically Optimal Close Formation Flight Control Based on Wingtip Vortex Structure

On the Interplay between Sensing and Communications for UAV Trajectory Design

Receding horizon control for multiple UAV formation flight based on modified brain storm optimization

Leader-follower Formation Consensus of Quadrotor UAVs Based on Prescribed Performance Adaptive Constrained Backstepping Control

Multi-UAV obstacle avoidance control via multi-objective social learning pigeon-inspired optimization

A Two-Step Optimization-Based Iterative Learning Control for Quadrotor Unmanned Aerial Vehicles

Automatic PID Tuning Via Differential Evolution for Quadrotor UAVs Trajectory Tracking

Extremum Seeking-Based Radio Signal Strength Optimization Algorithm for Hoverable UAV Path Planning

Design and Optimization of a Piecewise Flight Controller for VTOL UAVs

Horizontal Path Following Kinematic Controller for a Small Fixed-wing UAV Using Backstepping and Parameter Optimization

Semi-Aerodynamic Model Aided Invariant Kalman Filtering for UAV Full-State Estimation

An Optimal FASA Approach for UAV Trajectory Tracking Control

Enhanced PSO-Tuned Fractional-Order Adaptive Model Predictive Control for Robust UAV-Quadrotor Trajectory Tracking