Incremental Newton’s iterative algorithm for optimal control of Itô stochastic systems

Jiayue Tian,Xueyan Zhao,Feiqi Deng
DOI: https://doi.org/10.1016/j.amc.2022.126958
IF: 4.397
2022-05-01
Applied Mathematics and Computation
Abstract:In this paper, a novel incremental Newton’s iterative algorithm for investigating the optimal control problem of Itô stochastic systems is presented. Newton’s method is employed under the Fréchet derivative framework to iteratively solve a stochastic algebraic Riccati equation. Under moderate conditions, the convergence and even quadratic convergence of the proposed incremental Newton’s iterative algorithm are discussed, respectively. In addition, the Newton’s method is extended to the one with linear search. In the end, numerical results are given to demonstrate the effectiveness and superiority of the proposed algorithms.
mathematics, applied
What problem does this paper attempt to address?