Abstract:SIAM Journal on Control and Optimization, Volume 62, Issue 5, Page 2776-2806, October 2024. We study mean-field control problems in discrete time under the infinite horizon average cost optimality criteria. We focus on both the finite population and the infinite population setups. We show the existence of a solution to the average cost optimality equation (ACOE) and the existence of optimal stationary Markov policies for finite population problems under (i) a minorization condition that provides geometric ergodicity on the collective state process of the agents, and (ii) under standard Lipschitz continuity assumptions on the stagewise cost and transition function of the agents when the Lipschitz constant of the transition function satisfies a certain bound. For the infinite population problem, we establish the existence of a solution to the ACOE, and the existence of optimal policies under the continuity assumptions on the cost and the transition functions. Finally, we relate the finite population and infinite population control problems: (i) we prove that the optimal value of the finite population problem converges to the optimal value of the infinite population problem as the number of agents grows to infinity; (ii) we show that the accumulation points of the finite population optimal solution corresponds to an optimal solution for the infinite population problem; and finally (iii) we show that one can use the solution of the infinite population problem for the finite population problem symmetrically across the agents to achieve near optimal performance when the population is sufficiently large.

An Optimal Solution to Infinite Horizon Nonlinear Control Problems: Part II

Data-Driven Near-Optimal Control of Nonlinear Systems Over Finite Horizon

Neural network-based finite-horizon optimal control of uncertain affine nonlinear discrete-time systems

The Finite-Horizon Optimal Control for a Class of Time-Delay Affine Nonlinear System

Optimal Control for a Class of Infinite Dimensional Systems Involving an $L^\infty$-term in the Cost Functional

Infinite Horizon Sparse Optimal Control

Nonstationary Discrete-Time Deterministic And Stochastic Control Systems With Infinite Horizon

A Multilevel Approach for Stochastic Nonlinear Optimal Control

A Quasi-Infinite Horizon Predictive Control Scheme for Constrained Nonlinear Systems

Optimal Control of Discrete-Time Nonlinear Systems

Nearly Finite-Horizon Optimal Control for A Class of Nonaffine Time-Delay Nonlinear Systems Based on Adaptive Dynamic Programming

Optimal Control for Nonlinear Interconnected Large-scale Systems: A Successive Approximation Approach

Finite-time Stabilization for a Class of Nonlinear Systems Via Optimal Control

Nearly Finite-Horizon Optimal Control for Nonaffine Time-Delay Nonlinear Systems

Neuro-Optimal Control of Unknown Nonaffine Nonlinear Systems with Saturating Actuators.

Adaptive dynamic programming for infinite horizon optimal robust guaranteed cost control of a class of uncertain nonlinear systems

Infinite Horizon Average Cost Optimality Criteria for Mean-Field Control

Stability of Finite Horizon Model Predictive Control with Incremental Input Constraints.

Neural Network Solution for Suboptimal Control of Non-Holonomic Chained Form System

Adaptive Optimal Control for a Class of Continuous-Time Affine Nonlinear Systems with Unknown Internal Dynamics

Optimal Infinite-Horizon Mixed $\mathit{H}_2/\mathit{H}_\infty$ Control