Abstract:Most existing model-based cooperative tracking control approaches heavily rely on precise dynamic models and overlook the transient performance, ultimately resulting in the designed controller falling far short of optimal control effectiveness. To address this issue, this paper proposes a novel switching learning algorithm to optimize the optimal formation tracking control in unknown heterogeneous multi-agent systems. Firstly, a distributed observer-based decentralized formation control protocol is proposed to provide the state estimation of the leader, where the estimated leader's state facilitates that each agent maintains formation distance between the leader and the formation process. Secondly, a decentralized control policy is considered and learned by the iterative solution of the Bellman equation to achieve the optimal formation tracking control for each agent. However, the aforementioned obtained results heavily rely on the system dynamics and an initial stabilizing control policy. To relax these limitations, a data-based switching learning algorithm is proposed, and it consists of a model-free matrix updating learning algorithm and a data-based policy iteration algorithm. In contrast to existing algorithms for similar studies, the proposed algorithms eliminate the system model and initial stabilizing requirements, but also ensure the formation control in an optimal control way. Finally, a practical connected automated vehicles example is given to verify the theoretical analysis.

Formation Control of Discrete-Time Multi-Agent Systems by Iterative Learning Approach

An iterative learning approach to formation control of discrete‐time multi‐agent systems With varying trial lengths

An Iterative Learning Control Approach For Synchronization Of Multi-Agent Systems Under Iteration-Varying Graph

Adjacent-Agent Dynamic Linearization-Based Iterative Learning Formation Control

Distributed Formation Control with Open-Loop Nash Strategy

Finite-time formation control for multi-agent systems

A Multi-agent Formation Control Algorithm in Interference Environment

Leader-following Formation Control Based on Pursuit Strategies

Formation control for discrete‐time heterogeneous multi‐agent systems

Time-varying formation control for general linear multi-agent systems with switching directed topologies

Event-Triggered Distributed Data-Driven Iterative Learning Bipartite Formation Control for Unknown Nonlinear Multiagent Systems

Iterative Learning Formation Control via Input Sharing for Fractional-Order Singular Multi-Agent Systems with Local Lipschitz Nonlinearity

Leader-Follower Formation Learning Control of Discrete-Time Nonlinear Multiagent Systems

Switching Learning-Based Cooperative Control with Its Application to Connected Automated Vehicles

Iterative learning control for nonlinear heterogeneous multi-agent systems with multiple leaders

Neural-network-based fully distributed formation control for nonlinear multi-agent systems with event-triggered communication

Formation Control for High-Order Linear Time-Invariant Multi-Agent Systems with Time Delays

Decentralized Cooperative Control for Multivehicle Formation Without Velocity Measurement

Formation Control of Multi-agent Systems Over Directed Topologies: A Sliding Mode Control Approach With Prescribed-time Convergence

Distributed Formation Control Of Singular Multi-Agent Systems

Consensus Control for A Class of Second-Order Multi-Agent Systems: an Iterative Learning Approach