Abstract:We introduce Mean Field Markov games with $N$ players, in which each individual in a large population interacts with other randomly selected players. The states and actions of each player in an interaction together determine the instantaneous payoff for all involved players. They also determine the transition probabilities to move to the next state. Each individual wishes to maximize the total expected discounted payoff over an infinite horizon. We provide a rigorous derivation of the asymptotic behavior of this system as the size of the population grows to infinity. Under indistinguishability per type assumption, we show that under any Markov strategy, the random process consisting of one specific player and the remaining population converges weakly to a jump process driven by the solution of a system of differential equations. We characterize the solutions to the team and to the game problems at the limit of infinite population and use these to construct near optimal strategies for the case of a finite, but large, number of players. We show that the large population asymptotic of the microscopic model is equivalent to a (macroscopic) mean field stochastic game in which a local interaction is described by a single player against a population profile (the mean field limit). We illustrate our model to derive the equations for a dynamic evolutionary Hawk and Dove game with energy level.

Multiple-Population Discrete-Time Mean Field Games with Discounted and Total Payoffs: The Existence of Equilibria

Multiple-Population Discrete-Time Mean Field Games with Discounted and Total Payoffs: The Existence of Equilibria

Multiple-Population Discrete-Time Mean Field Games with Discounted and Total Payoffs: Approximation of Games with Finite Populations

Discrete Mean Field Games: Existence of Equilibria and Convergence

Discrete-time indefinite linear-quadratic mean field games and control: The finite-population case

Strong solutions of mean-field FBSDEs and their applications to multi-population mean-field games

Mean Field Asymptotics of Markov Decision Evolutionary Games and Teams

Pasting of Equilibria and Donsker-type Results for Mean Field Games

Mean-field games among teams

Mean-Field Games with common Poissonian noise: a Maximum Principle approach

Multi-population Mean Field Games with Multiple Major Players: Application to Carbon Emission Regulations

On non-unique solutions in mean field games

A Model Problem for First Order Mean Field Games with Discrete Initial Data

Social optimum of finite mean field games: existence and uniqueness of equilibrium solutions in the finite horizon and stationary solutions in the infinite horizon

Multiple equilibria in mean-field game models for large oligopolies with strategic complementarities

Mean Field Games with Ergodic cost for Discrete Time Markov Processes

Direct Approach of Indefinite Linear-Quadratic Mean Field Games

A Probabilistic Approach to Discounted Infinite Horizon and Invariant Mean Field Games

Set Values for Mean Field Games

Existence and uniqueness results for a mean-field game of optimal investment

Binary Mean Field Stochastic Games: Stationary Equilibria and Comparative Statics