Adaptive Optimization Algorithm for Nonlinear Markov Jump Systems with Partial Unknown Dynamics

Haiyang Fang,Guozheng Zhu,Vladimir Stojanovic,Rong Nie,Shuping He,Xiaoli Luan,Fei Liu
DOI: https://doi.org/10.1002/rnc.5350
IF: 3.8973
2021-01-01
International Journal of Robust and Nonlinear Control
Abstract:An online adaptive optimal control problem for a class of nonlinear Markov jump systems (MJSs) is studied. It is worth noting that the dynamic information of MJSs is partially unknown. Applying the neural network linear differential inclusion techniques, the nonlinear terms in MJSs are approximately converted to linear forms. By using subsystem transformation schemes, we can transfer the nonlinear MJSs to N new coupled linear subsystems. Then a new online policy iteration algorithm is put forward to obtain the adaptive optimal controller. Some theorems are given afterward to ensure the convergence of the new algorithm. At last, a simulation example is provided to verify the applicability of the algorithm.
What problem does this paper attempt to address?