Optimal Control of Stochastic Differential Equations via Fokker–Planck Equations

Ştefana-Lucia Aniţa
DOI: https://doi.org/10.1007/s00245-021-09804-5
2021-07-20
Abstract:This paper concerns an optimal control problem with feedback inputs related to a stochastic differential equation and an associated deterministic optimal control problem with open-loop controllers for a certain Fokker–Planck equation. Some basic properties of the weak solutions to the stochastic differential equation and to the Fokker–Planck equation are investigated and the relationship between them is discussed. Under certain assumptions, the equivalence between the stochastic and the deterministic optimal control problems is proven. A maximum principle is established and necessary optimality conditions for the deterministic problem are derived. A similar result can be obtained in the case of time-independent controllers. The existence of an optimal control is proven under additional hypotheses for the deterministic problem. These results enable gaining a deeper insight into the initial stochastic optimal control problem. Some examples and possible extensions illustrate the applicability of the theoretical results. A few auxiliary results concerning the weak solution to the Fokker–Planck equation are also discussed.
mathematics, applied
What problem does this paper attempt to address?