Abstract:Notwithstanding the successful design of state-of-the-art cooperative control protocols to accomplish formation tracking for multiple unmanned aerial vehicles (UAVs), the assurance of performance optimality cannot be guaranteed in the face of complex disturbances affecting these multi-UAV systems. In order to surmount this challenge, this research endeavor aims to establish a feedforward-feedback learning-based optimal control methodology to facilitate cooperative UAV formation tracking in the presence of intricate disturbances. To be more precise, by leveraging backstepping-based feedback control, the problem of UAV formation tracking is transformed into an equivalent optimal regulation problem. Consequently, a learning-based feedforward control scheme is devised, wherein the cooperative policy iteration algorithm is formulated based on a two-player zero-sum game. The critic-only echo state network (ESN) is employed to approximate the optimal feedforward control policies, with the inclusion of an online adaptive tuning law and compensation terms to alleviate the persistence of excitation condition and eliminate the need for an initial admissible control. As a result, the closed-loop stability is guaranteed in terms of uniformly ultimately boundedness for tracking errors and ESN weights. Note to Practitioners—In real-world scenarios, the flight of multiple UAVs is invariably affected by intricate disturbances, resulting in compromised tracking precision. There is an urgent need to enhance resistance to disturbances and ensure optimal performance for cooperative formation tracking of multiple UAVs. Beyond the capabilities of model-based controllers, the integration of reinforcement learning has shown promise in achieving robust control actions. By introducing the cooperative policy iteration algorithm based on a two-player zero-sum game, the tracking performances of UAV formation can be further optimized. In order to facilitate the practical application of reinforcement learning in UAV systems, our proposed algorithm addresses the persistency of excitation condition by incorporating innovative compensation terms into the ESN tuning law. Furthermore, we resolve the requirement for initial admissible control by introducing a novel piecewise compensation term into the ESN tuning law, which is based on a newly proposed Lyapunov function.

Observer-based robust cooperative formation tracking control for multiple combine harvesters

Robust Leader–Follower Control for Cooperative Harvesting Operation of a Tractor-Trailer and a Combine Harvester Considering Confined Space

Robust Predictive Palstance Control of Combine Cylinder Threshing

Low-complexity Formation Control of Marine Vehicle System Based on Prescribed Performance

Coordinated Saturated Output-Feedback Control of an Autonomous Tractor-Trailer and a Combine Harvester in Crop-Harvesting Operation

Robust Formation Tracking Control for Noncooperative Heterogeneous Multiagent Systems

Cooperative Time-Varying Formation Fuzzy Tracking Control of Multiple Heterogeneous Uncertain Marine Surface Vehicles with Actuator Failures.

Adaptive Time-Varying Formation Maneuvering Control for Multi-Robot Systems in Complex Obstacle-Rich Environments

A nonlinear observer-based approach to robust cooperative tracking for heterogeneous spacecraft attitude control and formation applications

Distributed Observer-Based Formation Tracking Control of Multi-Agent Systems with Multiple Targets of Unknown Periodic Inputs

Observation-Driven Multiple UAV Coordinated Standoff Target Tracking Based on Model Predictive Control

Observer‐based neural adaptive control of a platoon of autonomous tractor–trailer vehicles with uncertain dynamics

Hybrid Visual Servoing Tracking Control of Uncalibrated Robotic Systems for Dynamic Dwarf Culture Orchards Harvest

Robust Multiple Obstacle Tracking Method Based on Depth Aware OCSORT for Agricultural Robots

Robust distributed fixed-time cooperative hunting control for multi-quadrotor with obstacles avoidance

Improving trajectory tracking performance of autonomous farming vehicles using adaptive extended state observer and finite-time technique

A Versatile Control Method for Multi-Agricultural Machine Cooperative Steering Applicable to Two Steering Modes

Vision-Based Leader Vehicle Trajectory Tracking for Multiple Agricultural Vehicles

Cooperative Observer-Based Fuzzy Tracking Control for Nonlinear MASs Under DoS Attacks

Learning-Based Optimal Cooperative Formation Tracking Control for Multiple UAVs: A Feedforward-Feedback Design Framework

Adaptive Practical Optimal Time-Varying Formation Tracking Control for Disturbed High-Order Multi-Agent Systems