Abstract:SIAM Journal on Control and Optimization, Volume 62, Issue 5, Page 2776-2806, October 2024. We study mean-field control problems in discrete time under the infinite horizon average cost optimality criteria. We focus on both the finite population and the infinite population setups. We show the existence of a solution to the average cost optimality equation (ACOE) and the existence of optimal stationary Markov policies for finite population problems under (i) a minorization condition that provides geometric ergodicity on the collective state process of the agents, and (ii) under standard Lipschitz continuity assumptions on the stagewise cost and transition function of the agents when the Lipschitz constant of the transition function satisfies a certain bound. For the infinite population problem, we establish the existence of a solution to the ACOE, and the existence of optimal policies under the continuity assumptions on the cost and the transition functions. Finally, we relate the finite population and infinite population control problems: (i) we prove that the optimal value of the finite population problem converges to the optimal value of the infinite population problem as the number of agents grows to infinity; (ii) we show that the accumulation points of the finite population optimal solution corresponds to an optimal solution for the infinite population problem; and finally (iii) we show that one can use the solution of the infinite population problem for the finite population problem symmetrically across the agents to achieve near optimal performance when the population is sufficiently large.

One-dimensional multi-agent optimal control with aggregation and distance constraints: qualitative properties and mean-field limit

Constrained Containment Control for Multiagent Systems with Possible Empty Intersection of Position Constraints

High-dimensional continuification control of large-scale multi-agent systems under limited sensing and perturbations

Mean-Field Control for Diffusion Aggregation system with Coulomb Interaction

Mean-field control of non exchangeable systems

Decentralized Optimal Tracking Control for Large-scale Multi-Agent Systems under Complex Environment: A Constrained Mean Field Game with Reinforcement Learning Approach

Brief paper: On H∞ and H2 performance regions of multi-agent systems

Stochastic Optimal Control in Continuous Space-Time Multi-Agent Systems

Linear Quadratic Gaussian Mean-Field Controls of Social Optima

Discrete-time indefinite linear-quadratic mean field games and control: The finite-population case

Existence of Optimal Stationary Singular Controls and Mean Field Game Equilibria

Mean-field sparse optimal control

Decomposed resolution of finite-state aggregative optimal control problems

Mean-field limit for stochastic control problems under state constraint

A Lagrangian Approach for Aggregative Mean Field Games of Controls with Mixed and Final Constraints

Is Limited Information Enough? An Approximate Multi-agent Coverage Control in Non-Convex Discrete Environments

Optimal distributed cooperative control for multi-agent systems with constrains on convergence speed and control input

Mean Field Games of Controls with Dirichlet boundary conditions

Infinite Horizon Average Cost Optimality Criteria for Mean-Field Control