Abstract:SIAM Journal on Control and Optimization, Volume 60, Issue 2, Page 1163-1189, April 2022. In this paper, a Nash-type fictitious game framework is introduced for handling time-inconsistent linear-quadratic (LQ) optimal control problems. The Nash-type game in this framework is called fictitious as it is between the decision maker (called real player) and an auxiliary control variable (called fictitious player) with the real player and fictitious player looking for time-consistent policy and precommitted optimal policy, respectively. Namely, the fictitious game framework is actually an auxiliary-variable-based mechanism where the fictitious player is our particular design. Noting that the real player's cost functional is revised in accordance with that of the fictitious player, the equilibrium policy of the real player is called an open-loop self-coordination control of the original LQ problem. As a generalization, a time-inconsistent nonzero-sum stochastic linear-quadratic dynamic game is investigated, where one player looks for a precommitted optimal policy and the other player searches for a time-consistent policy. Necessary and sufficient conditions are presented to ensure the existence of open-loop equilibrium of the nonzero-sum game, which resort to a set of Riccati-like equations and linear equations. By applying the developed theory of nonzero-sum game, open-loop self-coordination control of the LQ optimal control is fully characterized, and multiperiod mean-variance portfolio selection is also investigated.

Sampled fictitious play is Hannan consistent

Consistency of vanishing smooth fictitious play

Anticipatory Fictitious Play

A Computationally Efficient Implementation of Fictitious Play for Large-Scale Games

Analysis of Hannan Consistent Selection for Monte Carlo Tree Search in Simultaneous Move Games

Intelligent Players in a Fictitious Play Framework

Empirical Analysis of Fictitious Play for Nash Equilibrium Computation in Multiplayer Games

A Counter-Example to Karlin's Strong Conjecture for Fictitious Play

Distributed Fictitious Play for Optimal Behavior of Multi-Agent Systems with Incomplete Information

Fictitious Play for Mean Field Games: Continuous Time Analysis and Applications

A Generalized Extensive-Form Fictitious Play Algorithm

Adaptive Forgetting Factor Fictitious Play

Fictitious Play in Markov Games with Single Controller

A Nash-Type Fictitious Game Framework to Time-Inconsistent Stochastic Control Problems

Learning by Fictitious Play in Large Populations

Fictitious Play with Maximin Initialization

Robustness Properties in Fictitious-Play-Type Algorithms

Convergence Analysis and Acceleration of Fictitious Play for General Mean-Field Games via the Best Response

Fictitious Play via Finite Differences for Mean Field Games with Optimal Stopping

From Weak Learning to Strong Learning in Fictitious Play Type Algorithms

On the Convergence of Fictitious Play: A Decomposition Approach