Optimal Tracking Control for Linear Discrete-Time Stochastic System Based on Adaptive Dynamic Programming

Fang Wang,Xin Chen,Wei Wang
DOI: https://doi.org/10.23919/chicc.2019.8866292
2019-01-01
Abstract:In this paper, an adaptive dynamic programming (ADP) algorithm based on value iteration is proposed to tackle the stochastic linear quadratic (SLQ) optimal tracking control problem for discrete-time systems subject to multiplicative noise. Firstly. an augmented system made up of the original system and the command generator is constructed and the condition of well-posedness for SLQ problem is given. Next, the SLQ problem is converted into the deterministic problem through system transformation. Then, ADP algorithm is utilized to solve the SLQ problem with convergence analysis. In the iteration process of ADP algorithm, the system dynamics are not essential to solve the Bellman equation but are needed to update the control gain matrix. Finally, simulation results have shown that the proposed scheme for the problem gives good tracking performance.
What problem does this paper attempt to address?