Abstract:This paper studies minimax optimization problems defined over infinite-dimensional function classes of overparameterized two-layer neural networks. In particular, we consider the minimax optimization problem stemming from estimating linear functional equations defined by conditional expectations, where the objective functions are quadratic in the functional spaces. We address (i) the convergence of the stochastic gradient descent-ascent algorithm and (ii) the representation learning of the neural networks. We establish convergence under the mean-field regime by considering the continuous-time and infinite-width limit of the optimization dynamics. Under this regime, the stochastic gradient descent-ascent corresponds to a Wasserstein gradient flow over the space of probability measures defined over the space of neural network parameters. We prove that the Wasserstein gradient flow converges globally to a stationary point of the minimax objective at a $O(T^{-1} + \alpha^{-1})$ sublinear rate, and additionally finds the solution to the functional equation when the regularizer of the minimax objective is strongly convex. Here $T$ denotes the time and $\alpha$ is a scaling parameter of the neural networks. In terms of representation learning, our results show that the feature representation induced by the neural networks is allowed to deviate from the initial one by the magnitude of $O(\alpha^{-1})$, measured in terms of the Wasserstein distance. Finally, we apply our general results to concrete examples including policy evaluation, nonparametric instrumental variable regression, asset pricing, and adversarial Riesz representer estimation.

Entropic mean-field min-max problems via Best Response flow

A Fisher-Rao gradient flow for entropic mean-field min-max games

Potential Mean-Field Games and Gradient Flows

Mean-Field Games with common Poissonian noise: a Maximum Principle approach

Symmetric Mean-field Langevin Dynamics for Distributional Minimax Problems

A Total Variation Flow Scheme for Ergodic Mean Field Games

Convergence of Policy Gradient for Entropy Regularized MDPs with Neural Network Approximation in the Mean-Field Regime

Convergence of the Min-Max Langevin Dynamics and Algorithm for Zero-Sum Games

Convergence Analysis and Acceleration of Fictitious Play for General Mean-Field Games via the Best Response

Coupled Wasserstein Gradient Flows for Min-Max and Cooperative Games

Best-response dynamics, playing sequences, and convergence to equilibrium in random games

Mean Field Games Master Equations: From Discrete to Continuous State Space

Entropic Fictitious Play for Mean Field Optimization Problem

Master equations for finite state mean field games with nonlinear activations

Entropic Optimal Planning for Path-Dependent Mean Field Games

Simultaneous Transport Evolution for Minimax Equilibria on Measures

A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization

Quantitative convergence for displacement monotone mean field games with controlled volatility

Minimal solutions of master equations for extended mean field games

Maximum Causal Entropy Inverse Reinforcement Learning for Mean-Field Games