Abstract:Notwithstanding the successful design of state-of-the-art cooperative control protocols to accomplish formation tracking for multiple unmanned aerial vehicles (UAVs), the assurance of performance optimality cannot be guaranteed in the face of complex disturbances affecting these multi-UAV systems. In order to surmount this challenge, this research endeavor aims to establish a feedforward-feedback learning-based optimal control methodology to facilitate cooperative UAV formation tracking in the presence of intricate disturbances. To be more precise, by leveraging backstepping-based feedback control, the problem of UAV formation tracking is transformed into an equivalent optimal regulation problem. Consequently, a learning-based feedforward control scheme is devised, wherein the cooperative policy iteration algorithm is formulated based on a two-player zero-sum game. The critic-only echo state network (ESN) is employed to approximate the optimal feedforward control policies, with the inclusion of an online adaptive tuning law and compensation terms to alleviate the persistence of excitation condition and eliminate the need for an initial admissible control. As a result, the closed-loop stability is guaranteed in terms of uniformly ultimately boundedness for tracking errors and ESN weights. Note to Practitioners—In real-world scenarios, the flight of multiple UAVs is invariably affected by intricate disturbances, resulting in compromised tracking precision. There is an urgent need to enhance resistance to disturbances and ensure optimal performance for cooperative formation tracking of multiple UAVs. Beyond the capabilities of model-based controllers, the integration of reinforcement learning has shown promise in achieving robust control actions. By introducing the cooperative policy iteration algorithm based on a two-player zero-sum game, the tracking performances of UAV formation can be further optimized. In order to facilitate the practical application of reinforcement learning in UAV systems, our proposed algorithm addresses the persistency of excitation condition by incorporating innovative compensation terms into the ESN tuning law. Furthermore, we resolve the requirement for initial admissible control by introducing a novel piecewise compensation term into the ESN tuning law, which is based on a newly proposed Lyapunov function.

Vertically Optimal Close Formation Flight Control Based on Wingtip Vortex Structure

Formation Control of Multi-UAV Systems with Time and Angle Constraints

Optimal Formation Control and Visual Simulation for Multiple Unmanned Aerial Vehicles (Uavs)

Robust Control for UAV Close Formation Using LADRC via Sine-Powered Pigeon-Inspired Optimization

Robust Cooperative Formation Control of Fixed-Wing Unmanned Aerial Vehicles

Extended State Observer-Based Continuous Finite Time Control for a Fixed-Wing Vertical Take-Off and Landing Unmanned Aerial Vehicle

Leader-follower Formation Control of Multiple Vertical Takeoff and Landing UAVs: Distributed Estimator Design and Accurate Trajectory Tracking

Distributed observer-based close formation control for UAV swarm under outside disturbances and wake interferences

Optimal UAV Formation Tracking Control with Dynamic Leading Velocity and Network-Induced Delays

Formation Control of Multi-UAV Systems Using Zeroing Dynamics Method

Design and flight-stability analysis of a closed fixed-wing unmanned aerial vehicle formation controller

Adaptive formation control of multiple vertical takeoff and landing UAVs

Adaptive Formation Tracking Control of Multiple Vertical Takeoff and Landing UAVs with Bearing-Only Measurements.

Extremum seeking control for UAV close formation flight via improved pigeon-inspired optimization

Integrated Optimal Formation Control of Multiple Unmanned Aerial Vehicles

Robust horizontal-plane formation control for small fixed-wing UAVs

Leader-follower Formation Consensus of Quadrotor UAVs Based on Prescribed Performance Adaptive Constrained Backstepping Control

Bearing-Based Distributed Formation Control of Multiple Vertical Take-Off and Landing UAVs

Optimal Unmanned Ground Vehicle—Unmanned Aerial Vehicle Formation-Maintenance Control for Air-Ground Cooperation

Robust finite-time cooperative formation control of UGV-UAV with model uncertainties and actuator faults

Learning-Based Optimal Cooperative Formation Tracking Control for Multiple UAVs: A Feedforward-Feedback Design Framework