Abstract:We studied sampled-data based continuous-time linear quadratic Gaussian adaptive mean field games for leader-follower multi-agent systems. Each agent had a dynamical model with the unknown parameters and minimized a quadratic-tracking type cost functional, which was a function of the state average terms of the leaders and followers. We designed the decentralized adaptive control strategies based on the sampled-data, the Nash certainty equivalence principle, and the recursive weighted least squares algorithm. First, for the continuous-time linear quadratic optimal tracking control problem with the unknown parameters of the dynamical model, we proposed an adaptive control law based on the sampled-data and the recursive weighted least squares algorithm and proved that the quadratic-tracking type cost functional under the sampled-data based adaptive control law deviated from that under a conventional full-state based optimal control law with the known parameters of the dynamical model by an infinitesimal of the sample step. Second, for the leader-follower mean field games, by the state aggregation method, we estimated the state average terms of the leaders and followers, respectively. Then, by the estimates of the state average terms and the local sampled-data, we proposed decentralized adaptive control strategies for leaders and followers. Furthermore, we proposed a new two-level Nash equilibrium analytical method and showed that the sequence of the sampled-data based decentralized adaptive control strategies designed was an asymptotic Nash equilibrium as the sample step tends to zero. Finally, we presented a numerical simulation to demonstrate the effectiveness of the sampled-data based decentralized adaptive control strategies.

Sampled-data based adaptive mean field games for leader-follower stochastic multi-agent systems

Linear-Quadratic Mean-Field Game for Stochastic Systems with Partial Observation

Linear-Quadratic Mean Field Stackelberg Stochastic Differential Game with Partial Information and Common Noise

Leader–follower mean field LQ games: A direct method

A Mean-Field Game for a Forward-Backward Stochastic System with Partial Observation and Common Noise

Adaptive Distributed Tracking Control for Markov Jump Multiagent Systems with a Non-Strict Leader

Observer-Based Distributed Mean-Square Consensus Design for Leader-Following Multiagent Markov Jump Systems.

Two system transformation data-driven algorithms for linear quadratic mean-field games

Discrete-time indefinite linear-quadratic mean field games and control: The finite-population case

Consensus of Multiagent Systems Using Aperiodic Sampled-Data Control

Cooperative output feedback tracking control of stochastic nonlinear heterogeneous multi‐agent systems

Incomplete Information Linear-Quadratic Mean-Field Games and Related Riccati Equations

Reinforcement Learning for Non-stationary Discrete-Time Linear–Quadratic Mean-Field Games in Multiple Populations

Large-Scale Multiagent System Tracking Control Using Mean Field Games

Direct Approach of Linear-Quadratic Stackelberg Mean Field Games of Backward-Forward Stochastic Systems

Cooperative Output Feedback Tracking Control of Stochastic Linear Heterogeneous Multi-Agent Systems

Mean Field Linear-Quadratic-Gaussian (LQG) Games of Forward-Backward Stochastic Differential Equations

Closed-Loop Solvability of Linear Quadratic Mean-Field Type Stackelberg Stochastic Differential Games

Stochastic Adaptive Linear Quadratic Differential Games

Distributed Adaptive Tracking Control of Hidden Leader-Follower Multi-Agent Systems with Unknown Parameters