Numerical solutions of optimal stopping problems for a class of hybrid stochastic systems
Philip A. Ernst,Xiaohang Ma,Masoud H. Nazari,Hongjiang Qian,Le Yi Wang,George Yin
DOI: https://doi.org/10.1016/j.nahs.2024.101507
IF: 5.477
2024-05-18
Nonlinear Analysis Hybrid Systems
Abstract:This paper is devoted to numerically solving a class of optimal stopping problems for stochastic hybrid systems involving both continuous states and discrete events. The motivation for solving this class of problems stems from quickest event detection problems of stochastic hybrid systems in broad application domains. We solve the optimal stopping problems numerically by constructing feasible algorithms using Markov chain approximation techniques. The key tasks we undertake include designing and constructing discrete-time Markov chains that are locally consistent with switching diffusions, proving the convergence of suitably scaled sequences, and obtaining convergence for the cost and value functions. Finally, numerical results are provided to demonstrate the performance of the algorithms.
automation & control systems,mathematics, applied