First- and Second-Order Maximum Principles for Discrete-Time Stochastic Optimal Control With Recursive Utilities (December 2021)

Teng Song,Bin Liu
DOI: https://doi.org/10.1109/tac.2023.3261345
IF: 6.549
2023-01-01
IEEE Transactions on Automatic Control
Abstract:This paper deals with the discrete-time stochastic optimal control problems with recursive utilities under weakened convexity assumption. A new stochastic maximum principle is established. Moreover, by constructing two new adjoint equations and two new variational equations for the backward stochastic difference equation (BS $Delta$ E), we obtain the second-order necessary optimality condition of quasi-singular control. Finally, as an illustration, a discrete-time mean-variance portfolio selection mixed with a recursive utility functional optimization problem is solved.
automation & control systems,engineering, electrical & electronic
What problem does this paper attempt to address?