Abstract:The focus of this paper is directed towards optimal control of multi-agent systems consisting of one leader and a number of followers in the presence of noise. The dynamics of every agent is assumed to be linear, and the performance index is a quadratic function of the states and actions of the leader and followers. The leader and followers are coupled in both dynamics and cost. The state of the leader and the average of the states of all followers (called mean-field) are common information and known to all agents; however, the local state of the followers are private information and unknown to other agents. It is shown that the optimal distributed control strategy is linear time-varying, and its computational complexity is independent of the number of followers. This strategy can be computed in a distributed manner, where the leader needs to solve one Riccati equation to determine its optimal strategy while each follower needs to solve two Riccati equations to obtain its optimal strategy. This result is subsequently extended to the case of the infinite horizon discounted and undiscounted cost functions, where the optimal distributed strategy is shown to be stationary. A numerical example with $100$ followers is provided to demonstrate the efficacy of the results.

Optimal control of first-order multi-agent systems with leaders

LQR-based optimal topology of leader-following consensus: LQR-based optimal topology of leader-following consensus

Suboptimal linear quadratic tracking control for multi-agent systems

Inverse optimal stabilization of cooperative control in networked multi-agent systems

Controllability of Second-Order Multiagent Systems with Multiple Leaders and General Dynamics

Optimal Distributed Leader-Following Consensus of Linear Multi-Agent Systems: A Dynamic Average Consensus-Based Approach

Distributed Containment Control of Linear Multi-Agent Systems with Multiple Leaders and Reduced-Order Controllers

Distributed Containment Control of Linear Multi-Agent Systems with Multiple Leaders of Bounded Unknown Inputs

Constrained Containment Control for Multiagent Systems with Possible Empty Intersection of Position Constraints

LQR-Based Optimal Leader-Follower Consensus of Second-Order Multi-agent Systems

Distributed optimal tracking control for second-order multi-agent systems

Containment of Linear Multi-Agent Systems with Multiple Leaders of Bounded Input and Exogenous Disturbances

Optimal Distributed Control for Leader-Follower Networks: A Scalable Design

Distributed Containment Control of Multi‐agent Systems with General Linear Dynamics in the Presence of Multiple Leaders

Linear Quadratic Leader-following Consensus of Multi-agent Systems: a Decentralized Computation and Distributed Information Fusion Strategy

Distributed Containment Control of Linear Multi-agent Systems with Multiple Higher-dimensional Leaders

Consensus Control of Multi-agent Systems with Optimal Performance

Controllability of a class of multi-agent systems with a leader

Output Containment Control for Heterogeneous Linear Multiagent Systems with Fixed and Switching Topologies.

Optimal distributed cooperative control for multi-agent systems with constrains on convergence speed and control input

Coordination for Linear Multiagent Systems with Dynamic Interaction Topology in the Leader-Following Framework