Abstract:Notwithstanding the successful design of state-of-the-art cooperative control protocols to accomplish formation tracking for multiple unmanned aerial vehicles (UAVs), the assurance of performance optimality cannot be guaranteed in the face of complex disturbances affecting these multi-UAV systems. In order to surmount this challenge, this research endeavor aims to establish a feedforward-feedback learning-based optimal control methodology to facilitate cooperative UAV formation tracking in the presence of intricate disturbances. To be more precise, by leveraging backstepping-based feedback control, the problem of UAV formation tracking is transformed into an equivalent optimal regulation problem. Consequently, a learning-based feedforward control scheme is devised, wherein the cooperative policy iteration algorithm is formulated based on a two-player zero-sum game. The critic-only echo state network (ESN) is employed to approximate the optimal feedforward control policies, with the inclusion of an online adaptive tuning law and compensation terms to alleviate the persistence of excitation condition and eliminate the need for an initial admissible control. As a result, the closed-loop stability is guaranteed in terms of uniformly ultimately boundedness for tracking errors and ESN weights. Note to Practitioners—In real-world scenarios, the flight of multiple UAVs is invariably affected by intricate disturbances, resulting in compromised tracking precision. There is an urgent need to enhance resistance to disturbances and ensure optimal performance for cooperative formation tracking of multiple UAVs. Beyond the capabilities of model-based controllers, the integration of reinforcement learning has shown promise in achieving robust control actions. By introducing the cooperative policy iteration algorithm based on a two-player zero-sum game, the tracking performances of UAV formation can be further optimized. In order to facilitate the practical application of reinforcement learning in UAV systems, our proposed algorithm addresses the persistency of excitation condition by incorporating innovative compensation terms into the ESN tuning law. Furthermore, we resolve the requirement for initial admissible control by introducing a novel piecewise compensation term into the ESN tuning law, which is based on a newly proposed Lyapunov function.

Fixed‐time backstepping distributed cooperative control for multiple unmanned aerial vehicles

Formation Control of Multi-UAV Systems with Time and Angle Constraints

Onboard Distributed Trajectory Planning Through Intelligent Search for Multi-UAV Cooperative Flight

Fixed-time fault-tolerant attitude tracking control for UAV based on fixed-time extended state observer

Fixed-Time Distributed Adaptive Formation Control for Multiple QUAVs with Full-State Constraints

Robust distributed fixed-time cooperative hunting control for multi-quadrotor with obstacles avoidance

Distributed global output-feedback formation control without velocity measurement for multiple unmanned surface vehicles

Distributed adaptive fault-tolerant close formation flight control of multiple trailing fixed-wing UAVs

Distributed fixed‐time sliding mode formation control for unmanned aerial‐ground vehicle (UAV‐UGV) heterogeneous system

Robust fixed-time formation control for quadrotor unmanned aerial vehicles with directed topology

Distributed MPC for Trajectory Tracking and Formation Control of Multi-UAVs With Leader-Follower Structure

Fixed-time distributed adaptive attitude control for multiple QUAVs with quantized input

Learning-Based Optimal Cooperative Formation Tracking Control for Multiple UAVs: A Feedforward-Feedback Design Framework

Distributed fixed-time formation tracking control for multiple underactuated USVs with lumped uncertainties and input saturation

Hierarchical Temporal Sequence Convergence in Prescribed-Time Control for Quadrotor UAVs Under Unknown Dynamic Disturbances

Distributed adaptive disturbance observer-based multi-channel event-triggered finite-time coordinated control for multi-UAVs with actuator failures

Distributed fixed-time leader-following formation control for multi-quadrotors with prescribed performance and collision avoidance

Distributed adaptive fixed-time formation control for UAV-USV heterogeneous multi-agent systems

Cooperative Trajectory Tracking of Multiple Unmanned Surface Vehicles via Distributed Time-Varying Optimization

Distributed Cooperative Search Algorithm With Task Assignment and Receding Horizon Predictive Control for Multiple Unmanned Aerial Vehicles

Distributed Formation Control for Multiple Quadrotor UAVs Based on Distributed Estimator and Singular Perturbation System