A Nash-Type Fictitious Game Framework to Time-Inconsistent Stochastic Control Problems
Yuan-Hua Ni,Binbin Si,Xinzhen Zhang
DOI: https://doi.org/10.1137/19M1281885
IF: 2.2
2022-04-29
SIAM Journal on Control and Optimization
Abstract:SIAM Journal on Control and Optimization, Volume 60, Issue 2, Page 1163-1189, April 2022. In this paper, a Nash-type fictitious game framework is introduced for handling time-inconsistent linear-quadratic (LQ) optimal control problems. The Nash-type game in this framework is called fictitious as it is between the decision maker (called real player) and an auxiliary control variable (called fictitious player) with the real player and fictitious player looking for time-consistent policy and precommitted optimal policy, respectively. Namely, the fictitious game framework is actually an auxiliary-variable-based mechanism where the fictitious player is our particular design. Noting that the real player's cost functional is revised in accordance with that of the fictitious player, the equilibrium policy of the real player is called an open-loop self-coordination control of the original LQ problem. As a generalization, a time-inconsistent nonzero-sum stochastic linear-quadratic dynamic game is investigated, where one player looks for a precommitted optimal policy and the other player searches for a time-consistent policy. Necessary and sufficient conditions are presented to ensure the existence of open-loop equilibrium of the nonzero-sum game, which resort to a set of Riccati-like equations and linear equations. By applying the developed theory of nonzero-sum game, open-loop self-coordination control of the LQ optimal control is fully characterized, and multiperiod mean-variance portfolio selection is also investigated.
mathematics, applied,automation & control systems