Abstract:SIAM Journal on Numerical Analysis, Volume 62, Issue 1, Page 1-24, February 2024. One of the core problems in mean-field control and mean-field games is to solve the corresponding McKean–Vlasov forward-backward stochastic differential equations (MV-FBSDEs). Most existing methods are tailored to special cases in which the mean-field interaction only depends on expectation or other moments and thus are inadequate to solve problems when the mean-field interaction has full distribution dependence. In this paper, we propose a novel deep learning method for computing MV-FBSDEs with a general form of mean-field interactions. Specifically, built on fictitious play, we recast the problem into repeatedly solving standard FBSDEs with explicit coefficient functions. These coefficient functions are used to approximate the MV-FBSDEs' model coefficients with full distribution dependence, and are updated by solving another supervising learning problem using training data simulated from the last iteration's FBSDE solutions. We use deep neural networks to solve standard BSDEs and approximate coefficient functions in order to solve high-dimensional MV-FBSDEs. Under proper assumptions on the learned functions, we prove that the convergence of the proposed method is free of the curse of dimensionality (CoD) by using a class of integral probability metrics previously developed in [J. Han, R. Hu, and J. Long, Stochastic Process. Appl., 164 (2023), pp. 242–287]. The proved theorem shows the advantage of the method in high dimensions. We present the numerical performance in high-dimensional MV-FBSDE problems, including a mean-field game example of the well-known Cucker–Smale model, the cost of which depends on the full distribution of the forward process.

Deep Learning Methods for Mean Field Control Problems With Delay

Deep learning for solving initial path optimization of mean-field systems with memory

Stochastic Maximum Principle for Generalized Mean-Field Delay Control Problem

A deep learning algorithm for computing mean field control problems via forward-backward score dynamics

Deep Learning for Population-Dependent Controls in Mean Field Control Problems with Common Noise

Mean-field neural networks-based algorithms for McKean-Vlasov control problems *

Learning High-Dimensional McKean–Vlasov Forward-Backward Stochastic Differential Equations with General Distribution Dependence

A Mean-Field Optimal Control Formulation of Deep Learning

Mean-field Langevin System, Optimal Control and Deep Neural Networks

Forward and Backward Mean-Field Stochastic Partial Differential Equation and Optimal Control

Infinite horizon McKean-Vlasov FBSDEs and applications to mean field control problems

Decentralized Control for Discrete-time Mean-Field Systems with Multiple Controllers of Delayed Information

The delay feedback control for the McKean-Vlasov stochastic differential equations with common noise

Mean Field Games with Mean-Field-Dependent Volatility: A PDE Approach

A fast iterative PDE-based algorithm for feedback controls of nonsmooth mean-field control problems

Mean Field Type Control Problems, Some Hilbert-space-valued FBSDEs, and Related Equations

Deep Learning for Mean Field Games and Mean Field Control with Applications to Finance

Mean Field Games with Common Noises and Conditional Distribution Dependent FBSDEs

Deep BSDE-ML Learning and Its Application to Model-Free Optimal Control

A machine learning framework for solving high-dimensional mean field game and mean field control problems

Multisymplectic Formulation of Deep Learning Using Mean--Field Type Control and Nonlinear Stability of Training Algorithm