Abstract:This paper considers mean field games with optimal stopping time (OSMFGs) where agents make optimal exit decisions, the coupled obstacle and Fokker-Planck equations in such models pose challenges versus classic MFGs. This paper proposes a generalized fictitious play algorithm that computes OSMFG mixed equilibria by iteratively solving pure strategy systems, i.e. approximating mixed strategies through averaging pure strategies according to a certain updating rule. The generalized fictitious play allows for a broad family of learning rates and the convergence to the mixed strategy equilibrium can be rigorously justified. The algorithm also incorporates efficient finite difference schemes of the pure strategy system, and numerical experiments demonstrate the effectiveness of the proposed method in robustly and efficiently computing mixed equilibria for OSMFGs.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the calculation problem of mixed - strategy equilibria in mean - field games with optimal stopping times (OSMFGs). Specifically: 1. **Model Challenges**: - In OSMFG, players need to decide when to quit the game to minimize the expected cost. This leads to obstacle problems and Fokker - Planck equations different from those in classical MFG. - Due to the singular nature of optimal - stopping control, pure - strategy equilibria do not exist, and mixed - strategy equilibria must be considered. 2. **Mathematical Difficulties**: - The PDE system of OSMFG is more complex than that of classical MFG, including forward - backward structures and relaxed exit conditions, all of which pose challenges to calculation. - Existing algorithms such as the Uzawa algorithm and large - scale linear programming methods have limitations when dealing with time - dependent problems and are not computationally efficient. 3. **Algorithm Innovation**: - The paper proposes an iterative algorithm based on generalized fictitious play, which approximates the mixed - strategy equilibrium by repeatedly solving the pure - strategy system. - This algorithm introduces a flexible learning rate and combines the finite - difference method to efficiently solve the obstacle problems and Fokker - Planck equations. 4. **Main Contributions**: - A new iterative method is proposed, which links pure - strategy and mixed - strategy, making it possible to obtain complex mixed - strategy equilibria by solving the simpler pure - strategy system. - The convergence of generalized fictitious play in a continuous setting is proved, and its effectiveness and stability in solving the OSMFG mixed - strategy equilibrium are demonstrated. In summary, the paper aims to solve the computational problem of mixed - strategy equilibria in mean - field games with optimal stopping times by developing an efficient numerical algorithm.

Fictitious Play via Finite Differences for Mean Field Games with Optimal Stopping

A fictitious-play finite-difference method for linearly solvable mean field games

Linear programming fictitious play algorithm for mean field games with optimal stopping and absorption

Convergence Analysis and Acceleration of Fictitious Play for General Mean-Field Games via the Best Response

Fictitious Play for Mean Field Games: Continuous Time Analysis and Applications

Provable Fictitious Play for General Mean-Field Games

Convergence of deep fictitious play for stochastic differential games

MF-OMO: An Optimization Formulation of Mean-Field Games

Signatured Deep Fictitious Play for Mean Field Games with Common Noise

Deep Fictitious Play for Stochastic Differential Games

RM-FSP: Regret Minimization Optimizes Neural Fictitious Self-Play

Learning in Herding Mean Field Games: Single-Loop Algorithm with Finite-Time Convergence Analysis

Learning Discrete-Time Major-Minor Mean Field Games

Fictitious Play in Markov Games with Single Controller

Monte Carlo Neural Fictitious Self-Play: Achieve Approximate Nash equilibrium of Imperfect-Information Games.

High order computation of optimal transport, mean field planning, and mean field games

Numerical methods for mean field games based on Gaussian processes and Fourier features

Closed-loop Equilibria for Mean-Field Games in Randomly Switching Environments with General Discounting Costs

Deep Learning Algorithms for Mean Field Optimal Stopping in Finite Space and Discrete Time

Optimal Strategy of Mean-Field FBSDE Games with Delay and Noisy Memory Based on Malliavin Calculus