Maximum Principle for Stochastic Optimal Control Problem of Forward-Backward Stochastic Difference Systems

Shaolin Ji,Haodong Liu
DOI: https://doi.org/10.1080/00207179.2021.1889033
2022-01-01
Optimal Control Applications and Methods
Abstract:This article studies the maximum principle for stochastic optimal control problems of forward-backward stochastic difference systems (FBS Delta Ss) where the uncertainty is modeled by a discrete time, finite state process, rather than white noises. Two distinct forms of FBS Delta Ss are investigated. The first one is described by a partially coupled forward-backward stochastic difference equation (FBS Delta E) and the second one is described by a fully coupled FBS Delta E. We deduce the adjoint difference equation by adopting an appropriate representation of the product rule and a proper formulation of the backward stochastic difference equation (BS Delta E). Finally, the maximum principle for this optimal control problem with the convex control domain is established.
What problem does this paper attempt to address?