Abstract:SIAM Journal on Control and Optimization, Volume 62, Issue 5, Page 2776-2806, October 2024. We study mean-field control problems in discrete time under the infinite horizon average cost optimality criteria. We focus on both the finite population and the infinite population setups. We show the existence of a solution to the average cost optimality equation (ACOE) and the existence of optimal stationary Markov policies for finite population problems under (i) a minorization condition that provides geometric ergodicity on the collective state process of the agents, and (ii) under standard Lipschitz continuity assumptions on the stagewise cost and transition function of the agents when the Lipschitz constant of the transition function satisfies a certain bound. For the infinite population problem, we establish the existence of a solution to the ACOE, and the existence of optimal policies under the continuity assumptions on the cost and the transition functions. Finally, we relate the finite population and infinite population control problems: (i) we prove that the optimal value of the finite population problem converges to the optimal value of the infinite population problem as the number of agents grows to infinity; (ii) we show that the accumulation points of the finite population optimal solution corresponds to an optimal solution for the infinite population problem; and finally (iii) we show that one can use the solution of the infinite population problem for the finite population problem symmetrically across the agents to achieve near optimal performance when the population is sufficiently large.

Necessary Conditions In Infinite-Horizon Control Problem That Need No Asymptotic Assumptions

The transversality conditions in infinite horizon problems and the stability of adjoint variable

Pontryagin Principles in Infinite Horizon in Presence of Asymptotical Constraints

An infinite-horizon optimal control problem and the stability of the adjoint variable (in Russian)

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Necessary Conditions for Stochastic Optimal Control Problems in Infinite Dimensions

Asymptotic problems in optimal control with a vanishing Lagrangian and unbounded data

Asymptotics of a Solution to an Optimal Control Problem with a Terminal Convex Performance Index and a Perturbation of the Initial Data

A Novel State-Centric Necessary Condition for Time-Optimal Control of Controllable Linear Systems Based on Augmented Switching Laws (Extended Version)

Asymptotics of the Solution of a Bisingular Optimal Distributed Control Problem in a Convex Domain with a Small Parameter Multiplying a Highest Derivative

Infinite Horizon Average Cost Optimality Criteria for Mean-Field Control

An Asymptotic Weak Maximum Principle

Representation of asymptotic values for nonexpansive stochastic control systems

A Quasi-Infinite Horizon Predictive Control Scheme for Constrained Nonlinear Systems

Optimal control on finite graphs: asymptotic optimal controls and ergodic constant in the case of entropic costs

Nonstationary Discrete-Time Deterministic And Stochastic Control Systems With Infinite Horizon

Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon

On receding-horizon approximation in time-varying optimal control

Optimal control of conditioned processes with feedback controls

Optimal Control Problem for the Cahn–Hilliard/Allen–Cahn Equation with State Constraint